| An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale A Dosovitskiy*, L Beyer*, A Kolesnikov*, D Weissenborn*, X Zhai*, ... International Conference on Learning Representations (ICLR), 2021 | 83144 | 2021 |
| MLP-Mixer: An all-MLP Architecture for Vision I Tolstikhin*, N Houlsby*, A Kolesnikov*, L Beyer*, X Zhai, T Unterthiner, ... Advances in Neural Information Processing Systems (NeurIPS), 2021 | 4125 | 2021 |
| Sigmoid loss for language image pre-training X Zhai*, B Mustafa, A Kolesnikov, L Beyer*, *equal contribution International Conference on Computer Vision (ICCV), 2023 | 2428 | 2023 |
| Big Transfer (BiT): General Visual Representation Learning A Kolesnikov*, L Beyer*, X Zhai*, J Puigcerver, J Yung, S Gelly, ... European Conference on Computer Vision (ECCV), 2020 | 1781 | 2020 |
| Scaling Vision Transformers X Zhai*, A Kolesnikov*, N Houlsby, L Beyer*, *equal contribution Computer Vision and Pattern Recognition (CVPR), 2022 | 1777 | 2022 |
| S4l: Self-supervised semi-supervised learning X Zhai*, A Oliver*, A Kolesnikov*, L Beyer*, *equal contribution International Conference on Computer Vision (ICCV), 1476-1485, 2019 | 1215 | 2019 |
| Underspecification Presents Challenges for Credibility in Modern Machine Learning A D'Amour*, K Heller*, D Moldovan*, B Adlam, B Alipanahi, A Beutel, ... Journal of Machine Learning Research (JMLR), 2020 | 1027 | 2020 |
| Pali: A jointly-scaled multilingual language-image model X Chen, X Wang, S Changpinyo, AJ Piergiovanni, P Padlewski, D Salz, ... International Conference on Learning Representations (ICLR), 2022 | 1014 | 2022 |
| Revisiting Self-Supervised Visual Representation Learning A Kolesnikov*, X Zhai*, L Beyer*, *equal contribution Computer Vision and Pattern Recognition (CVPR), 2019 | 993 | 2019 |
| How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers A Steiner*, A Kolesnikov*, X Zhai*, R Wightman, J Uszkoreit, L Beyer*, ... Transactions on Machine Learning Research (TMLR), 2022 | 940 | 2022 |
| Scaling vision transformers to 22 billion parameters M Dehghani, J Djolonga, B Mustafa, P Padlewski, J Heek, J Gilmer, ... International Conference on Machine Learning (ICML), 7480-7512, 2023 | 884 | 2023 |
| Simple Open-Vocabulary Object Detection with Vision Transformers M Minderer, A Gritsenko, A Stone, M Neumann, D Weissenborn, ... European Conference on Computer Vision (ECCV), 2022 | 856* | 2022 |
| Gemma 3 technical report G Team, A Kamath, J Ferret, S Pathak, N Vieillard, R Merhej, S Perrin, ... arXiv preprint arXiv:2503.19786, 2025 | 818 | 2025 |
| LiT: Zero-Shot Transfer with Locked-image Text Tuning X Zhai*, X Wang*, B Mustafa*, A Steiner*, D Keysers, A Kolesnikov, ... Computer Vision and Pattern Recognition (CVPR), 2022 | 782 | 2022 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark X Zhai*, J Puigcerver*, A Kolesnikov*, P Ruyssen, C Riquelme, M Lucic, ... arXiv preprint arXiv:1910.04867, 2019 | 612* | 2019 |
| Revisiting the Calibration of Modern Neural Networks M Minderer, J Djolonga, R Romijnders, F Hubis, X Zhai, N Houlsby, ... Advances in Neural Information Processing Systems (NeurIPS), 2021 | 551 | 2021 |
| Are we done with ImageNet? L Beyer*, OJ Hénaff*, A Kolesnikov*, X Zhai*, A Oord*, *equal contribution arXiv preprint arXiv:2006.07159, 2020 | 534 | 2020 |
| Paligemma: A versatile 3b vlm for transfer L Beyer*, A Steiner*, AS Pinto*, A Kolesnikov*, X Wang*, D Salz, ... arXiv preprint arXiv:2407.07726, 2024 | 506 | 2024 |
| Knowledge distillation: A good teacher is patient and consistent L Beyer*, X Zhai*, A Royer*, L Markeeva*, R Anil, A Kolesnikov*, ... Computer Vision and Pattern Recognition (CVPR), 2022 | 457 | 2022 |
| Self-Supervised GANs via Auxiliary Rotation Loss T Chen, X Zhai, M Ritter, M Lucic, N Houlsby Computer Vision and Pattern Recognition (CVPR), 12154-12163, 2019 | 401 | 2019 |
Alexey DosovitskiyInceptiveVerified email at inceptive.team
