1. Appalaraju, S., Jasani, B., Kota, B.U., Xie, Y., Manmatha, R.: Docformer: end-to-end transformer for document understanding. In: International Conference on Computer Vision, pp. 973–983 (2021)

   Google Scholar 

2. Bao, H., Dong, L., Piao, S., Wei, F.: Beit: bert pre-training of image transformers. In: International Conference on Learning Representations (2021)

   Google Scholar 

3. Chi, Z., et al.: InfoXLM: an information-theoretic framework for cross-lingual language model pre-training. In: 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 3576–3588 (2021)

   Google Scholar 

4. Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 4171–4186 (2019)

   Google Scholar 

5. Gu, Z., et al.: Xylayoutlm: towards layout-aware multimodal networks for visually-rich document understanding. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4583–4592 (2022)

   Google Scholar 

6. He, P., Liu, X., Gao, J., Chen, W.: Deberta: decoding-enhanced Bert with disentangled attention. In: The 9th International Conference on Learning Representations (2021)

   Google Scholar 

7. Hong, T., Kim, D., Ji, M., Hwang, W., Nam, D., Park, S.: BROS: a pre-trained language model focusing on text and layout for better key information extraction from documents. In: The 36th AAAI Conference on Artificial Intelligence, pp. 10767–10775 (2022)

   Google Scholar 

8. Huang, Y., Lv, T., Cui, L., Lu, Y., Wei, F.: Layoutlmv3: pre-training for document AI with unified text and image masking. In: The 30th ACM International Conference on Multimedia, pp. 4083–4091 (2022)

   Google Scholar 

9. Jaume, G., Ekenel, H.K., Thiran, J.: FUNSD: a dataset for form understanding in noisy scanned documents. In: The 2nd International Workshop on Open Services and Tools for Document Analysis, pp. 1–6 (2019)

   Google Scholar 

10. Lewis, D.D., Agam, G., Argamon, S., Frieder, O., Grossman, D.A., Heard, J.: Building a test collection for complex document information processing. In: The 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 665–666 (2006)

    Google Scholar 

11. Li, C., et al.: StructuralLM: structural pre-training for form understanding. In: The 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, vol. 1: Long Papers, pp. 6309–6318 (2021)

    Google Scholar 

12. Li, J., Xu, Y., Lv, T., Cui, L., Zhang, C., Wei, F.: Dit: self-supervised pre-training for document image transformer. In: The 30th ACM International Conference on Multimedia, pp. 3530–3539 (2022)

    Google Scholar 

13. Li, P., et al.: Selfdoc: self-supervised document representation learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5652–5660 (2021)

    Google Scholar 

14. Li, Y., et al.: Structext: structured text understanding with multi-modal transformers. In: The 21st ACM Multimedia Conference on Multimedia, pp. 1912–1920 (2021)

    Google Scholar 

15. Liu, Y., et al.: Roberta: a robustly optimized Bert pretraining approach. arXiv preprintarXiv:1907.11692 (2019)

16. Park, S., et al.: Cord: a consolidated receipt dataset for post-ocr parsing. In: Workshop on Document Intelligence at NeurIPS 2019 (2019)

    Google Scholar 

17. Peng, Q., et al.: ERNIE-layout: layout knowledge enhanced pre-training for visually-rich document understanding. In: Findings of the Association for Computational Linguistics: EMNLP 2022, pp. 3744–3756 (2022)

    Google Scholar 

18. Vaswani, A., et al.: Attention is all you need. Adv. Neural Inf. Process. Syst.30, 5998–6008 (2017)

    Google Scholar 

19. Wang, J., Jin, L., Ding, K.: LiLT: a simple yet effective language-independent layout transformer for structured document understanding. In: The 60th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 7747–7757 (2022)

    Google Scholar 

20. Wang, J., et al.: Towards robust visual information extraction in real world: new dataset and novel solution. In: The AAAI Conference on Artificial Intelligence, pp. 2738–2745 (2021)

    Google Scholar 

21. Wang, W., et al.: Ernie-mmlayout: multi-grained multimodal transformer for document understanding. arXiv preprintarXiv:2209.08569 (2022)

22. Xu, Y., et al.: LayoutLMv2: multi-modal pre-training for visually-rich document understanding. In: The 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, vol. 1: Long Papers, pp. 2579–2591 (2021)

    Google Scholar 

23. Xu, Y., Li, M., Cui, L., Huang, S., Wei, F., Zhou, M.: Layoutlm: pre-training of text and layout for document image understanding. In: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 1192–1200 (2020)

    Google Scholar 

24. Xu, Y., et al.: Layoutxlm: multimodal pre-training for multilingual visually-rich document understanding. arXiv preprintarXiv:2104.08836 (2021)

25. Zhai, M., et al.: Fast-structext: an efficient hourglass transformer with modality-guided dynamic token merge for document understanding. arXiv preprintarXiv:2305.11392 (2023)

26. Zhang, Z., Ma, J., Du, J., Wang, L., Zhang, J.: Multimodal pre-training based on graph attention network for document understanding. IEEE Trans. Multimedia25, 6743–6755 (2023)

    Article  Google Scholar 

Download references