| Look Before You Leap: An Exploratory Study of Uncertainty Analysis for Large Language Models Y Huang, J Song, Z Wang, S Zhao, H Chen, F Juefei-Xu, L Ma IEEE Transactions on Software Engineering, 2025 | 238* | 2025 |
| Promptcharm: Text-to-image generation through multi-modal prompting and refinement Z Wang, Y Huang, D Song, L Ma, T Zhang Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems …, 2024 | 140 | 2024 |
| Understanding (mis) behavior on the EOSIO blockchain Y Huang, H Wang, L Wu, G Tyson, X Luo, R Zhang, X Liu, G Huang, ... Proceedings of the ACM on Measurement and Analysis of Computing Systems 4 (2 …, 2020 | 112* | 2020 |
| A semantic-aware representation framework for online log analysis W Meng, Y Liu, Y Huang, S Zhang, F Zaiter, B Chen, D Pei 2020 29th International conference on computer communications and networks …, 2020 | 83 | 2020 |
| Testeval: Benchmarking large language models for test case generation W Wang, C Yang, Z Wang, Y Huang, Z Chu, D Song, L Zhang, AR Chen, ... Findings of the Association for Computational Linguistics: NAACL 2025, 3547-3562, 2025 | 62 | 2025 |
| Towards understanding the characteristics of code generation errors made by large language models Z Wang, Z Zhou, YH Da Song, S Chen, L Ma, T Zhang Proceedings of the IEEE/ACM 47th International Conference on software …, 2025 | 60* | 2025 |
| Logclass: Anomalous log identification and classification with partial labels W Meng, Y Liu, S Zhang, F Zaiter, Y Zhang, Y Huang, Z Yu, Y Zhang, ... IEEE Transactions on Network and Service Management 18 (2), 1870-1884, 2021 | 59 | 2021 |
| Generation-based differential fuzzing for deep learning libraries J Liu, Y Huang, Z Wang, L Ma, C Fang, M Gu, X Zhang, Z Chen ACM Transactions on Software Engineering and Methodology 33 (2), 1-28, 2023 | 33 | 2023 |
| Patchcensor: Patch robustness certification for transformers via exhaustive testing Y Huang, L Ma, Y Li ACM Transactions on Software Engineering and Methodology 32 (6), 1-34, 2023 | 32* | 2023 |
| Luna: A model-based universal analysis framework for large language models D Song, X Xie, J Song, D Zhu, Y Huang, F Juefei-Xu, L Ma IEEE Transactions on Software Engineering 50 (7), 1921-1948, 2024 | 26 | 2024 |
| VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulation Z Wang, Z Zhou, J Song, Y Huang, Z Shu, L Ma Proceedings of the ACM on Software Engineering 2 (FSE), 1615-1638, 2025 | 23* | 2025 |
| Towards understanding retrieval accuracy and prompt quality in rag systems S Zhao, Y Huang, J Song, Z Wang, C Wan, L Ma arXiv preprint arXiv:2411.19463, 2024 | 22 | 2024 |
| Summarizing unstructured logs in online services W Meng, F Zaiter, Y Huang, Y Liu, S Zhang, Y Zhang, Y Zhu, T Zhang, ... arXiv preprint arXiv:2012.08938, 2020 | 22 | 2020 |
| Multilingual blending: Llm safety alignment evaluation with language mixture J Song, Y Huang, Z Zhou, L Ma arXiv preprint arXiv:2407.07342, 2024 | 17 | 2024 |
| Online safety analysis for llms: a benchmark, an assessment, and a path forward X Xie, J Song, Z Zhou, Y Huang, D Song, L Ma IEEE Transactions on Artificial Intelligence, 2025 | 15 | 2025 |
| Are LLMs Correctly Integrated into Software Systems? Y Shao, Y Huang, J Shen, L Ma, T Su, C Wan 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE …, 2025 | 15* | 2025 |
| An empirical study of code generation errors made by large language models D Song, Z Zhou, Z Wang, Y Huang, S Chen, B Kou, L Ma, T Zhang 7th Annual Symposium on Machine Programming, 2023 | 13 | 2023 |
| An exploratory study of AI system risk assessment from the lens of data distribution and uncertainty Z Wang, Y Huang, L Ma, H Yokoyama, S Tokumoto, K Munakata arXiv preprint arXiv:2212.06828, 2022 | 12 | 2022 |
| DeepLens: interactive out-of-distribution data detection in NLP models D Song, Z Wang, Y Huang, L Ma, T Zhang Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems …, 2023 | 10 | 2023 |
| DeepSeer: Interactive RNN explanation and debugging via state abstraction Z Wang, Y Huang, D Song, L Ma, T Zhang Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems …, 2023 | 10 | 2023 |
Lei MaAssociate Professor, The University of Tokyo, Japan & University of Alberta, CanadaVerified email at acm.org
