Research
During my Bachelor’s and Master’s, I’ve primarily worked in the MultiComp Lab,
advised by Professor Louis-Philippe Morency.
I'm currently dedicating my efforts to understand the fine-grained visual grounding between visual elements and language.
Prior, I focused on developing models in generating nonverbal behavioral cues (gestures) conditioned on language to improve naturalness in human-robot interaction.
I work with Dr. Hae Won Park at the MIT Media Lab to predict people’s engagement with an agent using graphical models.
I am also collaborating with Professor Ruslan Salakhutdinov to teach robots to learn optimal policies just with language.
|
|
Low-resource Adaptation for Personalized Co-Speech Gesture Generation
Chaitanya Ahuja, Dong Won Lee,
Louis-Philippe Morency
CVPR, 2022
paper
/
|
|
Crossmodal clustered contrastive learning: Grounding of spoken language to gestures
Dong Won Lee, Chaitanya Ahuja,
Louis-Philippe Morency
ICMI GENEA Workshop, 2021
paper
/
presentation video
/
code
We propose a new crossmodal contrastive learning loss to encourage a stronger grounding between gestures and spoken language.
|
|
No Gestures Left Behind: Learning Relationships between Spoken Language and Freeform Gestures
Chaitanya Ahuja, Dong Won Lee, Ryo Ishii,
Louis-Philippe Morency
Findings at EMNLP, 2020
paper
/
code
We study relationships between spoken language and co-speech gestures to account for the long tail of text-gesture distribution.
|
|
Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional Mixture Approach
Chaitanya Ahuja, Dong Won Lee, Yukiko I. Nakano,
Louis-Philippe Morency
ECCV, 2020
project page
/
paper
/
code
We propose a new style transfer model to learn individual styles of speaker's gestures.
|
Blog
I spend some of my time writing about interesting things I come across while I study ML :)
|
Planned Submissions
3/07/2022: ECCV 2022
|
Mentors
I have been blessed to meet amazing mentors who have guided me to become a better researcher (and more importantly, a good person).
I believe that I can only repay what they've done for me by assisting others in their journey in any way I can.
Please don't hesitate to reach out!
Mentors and Advisors: (in Alphabetical Order)
- Ben Eysenbach - CMU
- Chaitanya Ahuja - CMU
- David Kosbie - CMU
- Hae Won Park - MIT
- Louis-Phillipe Morency - CMU
- Mark Stehlik - CMU
|
|