I am passively interested in talking about industry research scientist and engineering positions in model evaluation and benchmarking, metric design, post-training alignment, model explanation, and interpretation, and, work at the intersection of LLMs and productivity or health (see publications and research notes). If you have any in mind, please reach out to me.
I am also interested in collaborations in the aforementioned areas. If you have an interesting project, and would like to collaborate or talk, or just want to talk about research in general, please pick a time slot here.
Last Updated @ Jun 6, 2025
Hi, I am Mimansa
I obtained my doctorate in CS at the University of Michigan under Prof. Emily Provost as part of the CHAI group. My research focuses on developing cost-effective data collection and generation procedures, LLM orchestration schemas, and, designing evaluation methods and metrics that are interpretable and human aligned.
I've previously interned at Allen AI NLP, Facebook AI Research (FAIR) NLP, and Facebook Research Conversational AI.
Besides research, I am interested in science communication, sketchnoting, personal knowledge management and cooking.
I ❤️ cats, and they keep me sane. I have two: Oreo and Bert (yes, that Bert, you read it right!).
Updates
2025February I started working at Meta’s MSL team working on post-training for model use-cases.
Previously,
2023October I submitted my thesis and joined Norm AI as a Member of Technical Staff. I will be working on evaluation and RAG.
May Defended my PhD titled Implicit Design Choices and Their Impact on Emotion Recognition Model Development and Evaluation. Read my acknowledgement page here.
2022May I was selected as one of the 8 Barbour fellows for 2022-2023 across all of UMich.
2021November Defended my PhD proposal titled Implicit Design Choices and Their Impact on Emotion Recognition Model Development and Evaluation. Read my acknowledgement page here
October I will be presenting our work on sociolinguistic inspired privacy evaluation at text as data (TADA) conference 2021, UMich, Ann Arbor.
September I am interning this Fall in Allen AI with Ana Marasović in the area of evaluation and interpretability.
May Excited to be interning in the FAIR NLP group this summer and looking forward to work at the intersection of Linguistics and ML.
2020September I have been chosen as the student representative for Faculty Hiring at my university for the 2020-21 season. Looking forward to knowing and communicating the 'usually hidden' processes.
May Excited to be interning in the Conversation AI group at Facebook AI working on automated dialogue evaluation.
2019December I'll be attending NeuRIPS. Shoot me an email if you want to meet and talk about anything!
January I'll be a teaching assistant for the course on Applied Machine Learning for Affective Computing with my advisor. So excited to be teaching for the first time!
Experience
Feb 2025 - present Research Scientist, MSL, Meta AI
Part of Meta AI's Capabilities team, focused on large language model (LLM) fine-tuning, and post-training techniques (RLHF, synthetic data generation and evaluation)
Oct 2023 - Oct 2024 Member of Technical Staff, Norm AI
Retrieval Augmentation and persona based simulation in LLMs and their subjective evaluation
Fall 2021 Research Intern, Allen NLP, Allen Institute of Artificial Intelligence
Mentor(s) : Ana Marasović
Benchmarking interpretable and compositional evaluation for very large models in natural language processing
Summer 2021 Research Intern, NLP Team, Facebook AI Research (Meta AI)
Mentor(s) : Adina Williams; Scott Yih, Pedro Rogieruez
Identifying, understanding, and correcting ambiguity based faliure points in Natural Language Inference (NLI)
Summer 2020 Research Intern, Conversation AI, Facebook (Meta) AI
Mentor(s) : Ahmad Beirami, Shane Moon, Satwik Kottur, Chinnadhurai Sankar
Defining interpretable and generalizable user satisfaction metric informed by human knowledge
Summer 2016 Research Intern, SENTIC Lab, Nanyang Technological University, Singapore
Mentor(s) : Erik Cambria
Multimodal detection of human behavior: empathy and deception
Winter 2016 Research Intern, NLP and Sentiment Analysis (NLPSA) Lab, Academia Sinica, Taiwan
Mentor(s) : Lun-Wei Ku
Human perception of conversation sentiment visualization in chat interfaces
Summer 2015 Research Intern, Indraprastha Institute of Information Technology (IIIT), Delhi
Mentor(s) : Pravesh Biyani
Finding the optimal routes under user specified user-constraints for last mile cab-pooling
Education
2017 - 2023 PhD in Computer Science and Engineering
University of Michigan
Advisor(s): Prof. Emily Provost
2017 - 2019 MS in Computer Science and Engineering
University of Michigan
Advisor(s): Prof. Emily Provost
2013 - 2017 BTech in Computer Engineering
IET DA Univ, India
Advisor(s): Prof. G.L. Prajapati