I am an associate professor at Carnegie Mellon University, with joint appointments in the Machine Learning and Computer Science departments. My group's research is centered around the science of evaluation and the evaluation of science. We develop algorithms with strong theoretical guarantees, as well as conduct large-scale controlled experiments for evidence-based policy design and real-world deployments.

Our research uses human-AI collaboration to address fundamental questions about scientific work: Is the research correct? Is it high-quality? Is it fundable, or even authentic? These questions are critical because inaccurate or flawed scientific findings can disrupt subsequent research, resulting in significant setbacks to scientific advancement. Additionally, problems in research evaluation affect billions of dollars in funding decisions, have directly contributed to fatalities in areas such as biomedicine, and impose substantial stress on students whose careers depend on fair assessment. Moreover, ensuring the integrity and accuracy of published science is crucial for maintaining public trust. Our research has already been used in the evaluation of over 100,000 research papers and thousands of grant proposals, demonstrating substantial real-world impact. Beyond science, the challenges our research addresses extend naturally into other domains, and the algorithms we have developed are also deployed in diverse applications such as admissions decisions and competition judging.

I tend to keep my research group relatively small and work very closely with all of my students.

Survey on Challenges, Solutions, and Experiments in Peer Review, and associated tutorial slides

Blog on various aspects of academia, research, and peer review

Email: nihars [at] cs.cmu.edu
Office: GHC 8211




PUBLICATIONS




GROUP
Justin Payan
Justin Payan
Postdoc, Machine Learning Department
Balint Gyevnar
Balint Gyevnar
Postdoc, Machine Learning Department
(joint with Atoosa Kasirzadeh)
Alexander Goldberg
Alexander Goldberg
PhD student, Computer Science Department
(advised jointly with Giulia Fanti)
Madeline Kitch
Madeline Kitch
PhD student, Computer Science Department
Sarina Xi
Sarina Xi
MS student, Machine Learning
Vishisht Rao
Vishisht Rao
MS student, Machine Learning
Arshika Lalan
Arshika Lalan
MS student, Machine Learning
Orelia Pi
Orelia Pi
BS student, Computer Science
Noemi Barbagli
Noemi Barbagli
BS student, Statistics and Machine Learning
Ziming Luo
Ziming Luo
Research Associate

ALUMNI


Charvi Rastogi
Charvi Rastogi
PhD, Machine Learning Department
(advised jointly with Ken Holstein)
Steven Jecmen
Steven Jecmen
PhD, Computer Science Department
(advised jointly with Fei Fang)
Ivan Stelmakh
Ivan Stelmakh
PhD, Machine Learning Department
(advised jointly with Aarti Singh)
Jingyan Wang
Jingyan Wang
PhD, Robotics Institute
Janet Hsieh
Janet (Jhih-Yi) Hsieh
MS in Computer Science
(advised jointly with Aditi Raghunathan)
Ryan Liu
Ryan Liu
BS and MS in Computer Science
Carmel Baharav
Carmel Baharav
BS in Computer Science
Komal Dhull
Komal Dhull
BS in Computer Science
Wenxin Ding
Wenxin Ding
MS in Computer Science
BS in Mathematics and Computer Science
(advised jointly with Weina Wang)
Qiqi Xu
Qiqi Xu
MS in Machine Learning
(advised jointly with Hoda Heidari)


FUNDING We gratefully acknowledge support from the National Science Foundation, CMU Block center, CMU CyLab, ONR, a Google Research Scholar award, a JP Morgan Faculty Research Award, and an NSF-Amazon Fair AI research grant.



TEACHING
Fall 2025 10-715 Advanced Introduction to Machine Learning
Fall 2024 10-715 Advanced Introduction to Machine Learning
Spring 2024 15-281 Artificial Intelligence: Representation and Problem Solving
Fall 2023 10-715 Advanced Introduction to Machine Learning
Fall 2022 10-715 Advanced Introduction to Machine Learning
Spring 2022 15-780 Graduate Artificial Intelligence
Fall 2021 10-715 Advanced Introduction to Machine Learning
Spring 2021 15-780 Graduate Artificial Intelligence
Fall 2020 10-715 Advanced Introduction to Machine Learning
Spring 2020 15-780 Graduate Artificial Intelligence
Fall 2019 10-715 Advanced Introduction to Machine Learning
Spring 2019 15-780 Graduate Artificial Intelligence
Fall 2017 10-709 Fundamentals of Learning from the Crowd

In my spare time, I am also creating introductory machine learning short lectures in Hindi, accessible to anyone without requiring any math or programming knowledge: Link to Youtube videos



CURRICULUM VITAE EDUCATION
HONORS
  • Young Alumnus Medal, Indian Institute of Science 2024
  • Outstanding paper award and people's choice award, Workshop on ML Evaluation Standards at ICLR 2022
  • HCOMP Best Paper Award Honorable Mention 2022
  • JP Morgan Faculty Research Award 2022
  • Google Research Scholar award 2021
  • NSF CAREER award 2020-2025
  • Best paper nomination at AAMAS 2019
  • Mentored and co-authored Best Student Paper at AAMAS 2019 to my PhD student Jingyan Wang
  • PhD thesis received David J. Sakrison Memorial Prize for a "truly outstanding piece of research" at EECS, UC Berkeley, May 2017
  • Outstanding Graduate Student Instructor award at UC Berkeley, 2015-16
  • Microsoft Research PhD Fellowship, 2014-2016.
  • IEEE Data Storage Best Paper and Best Student Paper awards for years 2011 & 2012
  • Second place in the first ACM University Student Research Competition, 2013.
  • Berkeley Fellowship, 2011-13 (the most prestigious fellowship for incoming graduate students at UC Berkeley).
  • Excellence Award for the academic year 2011-2012 at UC Berkeley.
  • Prof. SVC Aiya Medal for the best master-of-engineering student in the ECE department at IISc, 2010.

SERVICE (outside CMU)
  • Scientific Integrity Chair, International Conference on Machine Learning 2025
  • co-Editor-in-Chief, Transactions on Machine Learning Research, 2025 onwards
  • Action Editor, Transactions on Machine Learning Research, 2022-2025
  • Associate Program Chair, AAAI 2022
  • Information Theory Society Survey, 2021
  • Program committee member/Senior PC member/Area Chair, AAAI, NeurIPS , ICML, IJCAI, AIStats, HCOMP.
  • Co-chair, EC 2024 Workshop on Incentives in Academia, NeurIPS 2014 workshop on Crowdsourcing and Machine-learning, ICML 2014 workshop on Crowdsourcing and Human-computation.
  • Reviewer, Proceedings of the National Academy of Sciences, Journal of Machine Learning Research, Journal of Artificial Intelligence Research, Annals of Statistics, Operations Research, Management Science, PLOS One, Proceedings of the IEEE, ACM Transactions on Economics and Computation, IEEE Transactions on Information Theory, IEEE Transactions on Signal Processing, IEEE Transactions on Communications, IEEE Transactions on Parallel and Distributed Systems, IEEE Communications Letters, IEEE Journal on Selected Areas in Communications, ACM Transactions on Intelligent Systems, NeurIPS, ICLR, ISIT, ACM EC, DISC, Netcod, Infocom, Globecom, ITW, MIT Press.

INDUSTRY EXPERIENCE
  • Intern, Microsoft Research Redmond, May 2013 to August 2013 and May 2014 to August 2014
      Crowdsourcing algorithms.

  • Project Associate, IISc-Infosys collaborative project, Bangalore, July 2010 to June 2011
      Algorithms for robust and efficient media content distribution networks.

  • Member of Technical Staff, Adobe Systems, Bangalore, July 2007 to July 2008.
      Worked on Adobe Captivate, an automated e-learning authoring tool.

AltStyle によって変換されたページ (->オリジナル) /