|
Hi, My name is Dong Won. My advisors and friends usually call me “Don" :) I’m an incoming graduate student at MIT in the Personal Robots Group at the Media Lab. I will be graduating from my Master's in Machine Learning (MSML) from the Machine Learning Department at Carnegie Mellon University in May 2022. I completed my B.S. in Machine Learning at CMU, as well. Email / CV / Google Scholar / Linkedin / Twitter / Github / Medium |
|
|
07/2021: Our paper on Crossmodal clustered contrastive learning: Grounding of spoken language to gestures is accepted to GENEA Workshop @ ICMI 2021. 06/2021: Graduated from my undergraduate degree at CMU! 05/2021: We are organizing the First Workshop on Crossmodal Social Animation at ICCV 2021. 09/2020: Our paper on No Gestures Left Behind: Learning Relationships between Spoken Language and Freeform Gestures is accepted at Findings at EMNLP 2020. 07/2020: Our paper on Style Transfer for Co-Speech Gesture Animation is accepted at ECCV 2020 |
|
During my Bachelor’s and Master’s, I’ve primarily worked in the MultiComp Lab, advised by Professor Louis-Philippe Morency. I'm currently dedicating my efforts to understand the fine-grained visual grounding between visual elements and language. Prior, I focused on developing models in generating nonverbal behavioral cues (gestures) conditioned on language to improve naturalness in human-robot interaction. I work with Dr. Hae Won Park at the MIT Media Lab to predict people’s engagement with an agent using graphical models. I am also collaborating with Professor Ruslan Salakhutdinov to teach robots to learn optimal policies just with language. |
|
Chaitanya Ahuja, Dong Won Lee, Louis-Philippe Morency CVPR, 2022 paper / |
|
Dong Won Lee, Chaitanya Ahuja, Louis-Philippe Morency ICMI GENEA Workshop, 2021 paper / presentation video / code We propose a new crossmodal contrastive learning loss to encourage a stronger grounding between gestures and spoken language. |
|
Chaitanya Ahuja, Dong Won Lee, Ryo Ishii, Louis-Philippe Morency Findings at EMNLP, 2020 paper / code We study relationships between spoken language and co-speech gestures to account for the long tail of text-gesture distribution. |
|
Chaitanya Ahuja, Dong Won Lee, Yukiko I. Nakano, Louis-Philippe Morency ECCV, 2020 project page / paper / code We propose a new style transfer model to learn individual styles of speaker's gestures. |
|
|
|
|
Chaitanya Ahuja, Dong Won Lee, Yukiko I. Nakano, Louis-Philippe Morency dataset page / download Link / code PATS was collected to study correlation of co-speech gestures with audio and text signals. The dataset consists of a diverse and large amount of aligned pose, audio and transcripts. |
|
|
|
Graduate TA, Spring 2022 |
|
Graduate TA, Spring 2021 |
|
Undergraduate TA, Fall 2019, Spring 2020, Fall 2020 (3 Semesters) |
|
|
Undergraduate TA, Fall 2020, Spring 2021 (2 Semesters) |
|
|
|
Publication Chair workshop page / video |
|
Reviewer |
|
Reviewer |
|
I spend some of my time writing about interesting things I come across while I study ML :) |
|
Explaning the intuition behind the formulation of Transformer’s positional embeddings. |
|
A more-detailed summary of C-Learning: Learning to Achieve Goals via Recursive Classification, which studies the problem of predicting and controlling future states distribution of an autonomous agent. |
|
|
|
Previously, I had the incredible opportunity to be a member of a South Korean special operations unit deployed to Abu Dhabi (AKH14). Find me here: photo |
|
3/07/2022: ECCV 2022 |
|
I have been blessed to meet amazing mentors who have guided me to become a better researcher (and more importantly, a good person). I believe that I can only repay what they've done for me by assisting others in their journey in any way I can. Please don't hesitate to reach out! Mentors and Advisors: (in Alphabetical Order)
|
|
Source: source code |