| BEiT: BERT Pre-Training of Image Transformers H Bao, L Dong, S Piao, F Wei International Conference on Learning Representations, 2022 | 4327 | 2022 |
| Swin Transformer V2: Scaling Up Capacity and Resolution Z Liu, H Hu, Y Lin, Z Yao, Z Xie, Y Wei, J Ning, Y Cao, Z Zhang, L Dong, ... International Conference on Computer Vision and Pattern Recognition, 2022 | 3291 | 2022 |
| Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks X Li, X Yin, C Li, X Hu, P Zhang, L Zhang, L Wang, H Hu, L Dong, F Wei, ... European Conference on Computer Vision (ECCV 2020), 2020 | 2656 | 2020 |
| MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers W Wang, F Wei, L Dong, H Bao, N Yang, M Zhou 34th Conference on Neural Information Processing Systems (NeurIPS 2020), 2020 | 2151 | 2020 |
| Unified Language Model Pre-training for Natural Language Understanding and Generation L Dong, N Yang, W Wang, F Wei, X Liu, Y Wang, J Gao, M Zhou, HW Hon 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), 2019 | 2123 | 2019 |
| Long Short-Term Memory-Networks for Machine Reading J Cheng, L Dong, M Lapata Conference on Empirical Methods in Natural Language Processing (EMNLP), 2016 | 1849 | 2016 |
| Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification L Dong, F Wei, C Tan, D Tang, M Zhou, K Xu The 52nd Annual Meeting of the Association for Computational Linguistics …, 2014 | 1378 | 2014 |
| Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks W Wang, H Bao, L Dong, J Bjorck, Z Peng, Q Liu, K Aggarwal, ... Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2023 | 1344* | 2023 |
| Kosmos-2: Grounding Multimodal Large Language Models to the World Z Peng, W Wang, L Dong, Y Hao, S Huang, S Ma, F Wei International Conference on Learning Representations, 2024 | 1169 | 2024 |
| Language to Logical Form with Neural Attention L Dong, M Lapata The 54th Annual Meeting of the Association for Computational Linguistics …, 2016 | 979 | 2016 |
| Knowledge Neurons in Pretrained Transformers D Dai, L Dong, Y Hao, Z Sui, F Wei Proceedings of the 60th Annual Meeting of the Association for Computational …, 2022 | 877 | 2022 |
| Language Is Not All You Need: Aligning Perception with Language Models S Huang, L Dong, W Wang, Y Hao, S Singhal, S Ma, T Lv, L Cui, ... 37th Conference on Neural Information Processing Systems (NeurIPS 2023), 2023 | 840 | 2023 |
| VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts H Bao, W Wang, L Dong, Q Liu, OK Mohammed, K Aggarwal, S Som, ... 36th Conference on Neural Information Processing Systems (NeurIPS 2022), 2022 | 783 | 2022 |
| Retentive Network: A Successor to Transformer for Large Language Models Y Sun, L Dong, S Huang, S Ma, Y Xia, J Xue, J Wang, F Wei arXiv preprint arXiv:2307.08621, 2023 | 686 | 2023 |
| MiniLLM: Knowledge distillation of large language models Y Gu, L Dong, F Wei, M Huang The Twelfth International Conference on Learning Representations, 2024 | 672 | 2024 |
| Question Answering over Freebase with Multi-Column Convolutional Neural Networks L Dong, F Wei, M Zhou, K Xu The 53rd Annual Meeting of the Association for Computational Linguistics and …, 2015 | 622 | 2015 |
| Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers D Dai, Y Sun, L Dong, Y Hao, Z Sui, F Wei Findings of the Association for Computational Linguistics: ACL 2023, 2023 | 589 | 2023 |
| Coarse-to-Fine Decoding for Neural Semantic Parsing L Dong, M Lapata Proceedings of the 56th Annual Meeting of the Association for Computational …, 2018 | 513 | 2018 |
| UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training H Bao, L Dong, F Wei, W Wang, N Yang, X Liu, Y Wang, S Piao, J Gao, ... Thirty-Seventh International Conference on Machine Learning, 7006--7016, 2020 | 490 | 2020 |
| InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training Z Chi, L Dong, F Wei, N Yang, S Singhal, W Wang, X Song, XL Mao, ... North American Association for Computational Linguistics (NAACL), 2021 | 450 | 2021 |
Furu WeiChief Scientist of Microsoft Research Asia, Distinguished Scientist at MicrosoftVerified email at microsoft.com
