| ASQA: Factoid questions meet long-form answers I Stelmakh, Y Luan, B Dhingra, MW Chang arXiv preprint arXiv:2204.06092, 2022 | 268 | 2022 |
| PeerReview4All: Fair and accurate reviewer assignment in peer review I Stelmakh, NB Shah, A Singh Algorithmic Learning Theory, 828-856, 2019 | 133 | 2019 |
| On testing for biases in peer review I Stelmakh, N Shah, A Singh Advances in Neural Information Processing Systems 32, 2019 | 62 | 2019 |
| Prior and prejudice: The novice reviewers' bias against resubmissions in conference peer review I Stelmakh, NB Shah, A Singh, H Daumé III Proceedings of the ACM on Human-Computer Interaction 5 (CSCW1), 1-17, 2021 | 56 | 2021 |
| Catch me if i can: Detecting strategic behaviour in peer assessment I Stelmakh, NB Shah, A Singh Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4794-4802, 2021 | 51 | 2021 |
| A novice-reviewer experiment to address scarcity of qualified reviewers in large conferences I Stelmakh, NB Shah, A Singh, H Daumé III Proceedings of the AAAI Conference on Artificial Intelligence 35 (6), 4785-4793, 2021 | 49 | 2021 |
| Peer reviews of peer reviews: A randomized controlled trial and other experiments A Goldberg, I Stelmakh, K Cho, A Oh, A Agarwal, D Belgrave, NB Shah PloS one 20 (4), e0320444, 2025 | 37 | 2025 |
| Debiasing evaluations that are biased by evaluations J Wang, I Stelmakh, Y Wei, NB Shah Proceedings of the aaai conference on artificial intelligence 35 (11), 10120 …, 2021 | 33 | 2021 |
| Crowdspeech and voxdiy: Benchmark datasets for crowdsourced audio transcription N Pavlichenko, I Stelmakh, D Ustalov arXiv preprint arXiv:2107.01091, 2021 | 31 | 2021 |
| A large scale randomized controlled trial on herding in peer-review discussions I Stelmakh, C Rastogi, NB Shah, A Singh, H Daumé III Plos one 18 (7), e0287443, 2023 | 30 | 2023 |
| Cite-seeing and reviewing: A study on citation bias in peer review I Stelmakh, C Rastogi, R Liu, S Chawla, F Echenique, NB Shah Plos one 18 (7), e0283980, 2023 | 26 | 2023 |
| A gold standard dataset for the reviewer assignment problem I Stelmakh, J Wieting, G Neubig, NB Shah arXiv preprint arXiv:2303.16750, 2023 | 24 | 2023 |
| To ArXiv or not to ArXiv: a study quantifying pros and cons of posting preprints online C Rastogi, I Stelmakh, X Shen, M Meila, F Echenique, S Chawla, ... arXiv preprint arXiv:2203.17259, 2022 | 17 | 2022 |
| How do authors’ perceptions of their papers compare with co-authors’ perceptions and peer-review decisions? C Rastogi, I Stelmakh, A Beygelzimer, YN Dauphin, P Liang, ... Plos one 19 (4), e0300710, 2024 | 12 | 2024 |
| A randomized controlled trial on anonymizing reviewers to each other in peer review discussions C Rastogi, X Song, Z Jin, I Stelmakh, H Daumé III, K Zhang, NB Shah PloS one 19 (12), e0315674, 2024 | 10 | 2024 |
| Towards fair, equitable, and efficient peer review I Stelmakh Proceedings of the AAAI Conference on Artificial Intelligence 35 (18), 15736 …, 2021 | 7 | 2021 |
| VLDB 2021 Crowd Science Challenge on Aggregating Crowdsourced Audio Transcriptions. D Ustalov, N Pavlichenko, I Stelmakh, D Kuznetsov CSW@ VLDB, 1-7, 2021 | 4 | 2021 |
| Making Scientific Peer Review Scientific I Stelmakh Ph. D. thesis, Carnegie Mellon University, 2022 | 2 | 2022 |
| No Rose for MLE: Inadmissibility of MLE for Evaluation Aggregation Under Levels of Expertise C Rastogi, I Stelmakh, N Shah, S Balakrishnan 2022 IEEE International Symposium on Information Theory (ISIT), 3168-3173, 2022 | 2 | 2022 |
| Causal Effect of Group Diversity on Redundancy and Coverage in Peer-Reviewing N Goyal, I Stelmakh, N Shah, H Daumé III arXiv preprint arXiv:2411.11437, 2024 | | 2024 |
Nihar B. ShahML and CS departments, Carnegie Mellon UniversityVerified email at cs.cmu.edu
