Hye-Young Jo

Hi, I'm Hye-Young,

An HCI researcher who came from fine art and film.

I am a PhD student in Computer Science at the University of Colorado Boulder, advised by Prof. Ryo Suzuki in the Programmable Reality Lab at the ATLAS Institute. I also worked as a research intern at Fujitsu and Autodesk.

My research goal is to expand people’s capacity to create and learn by building interactive systems with generative AI and extended reality. My work has been recognized and supported by the Google PhD Fellowship.

Latest News

  • Our Meet-Up, "Rethinking Human Creativity in the Generative AI Era," was accepted to CHI 2027! πŸŽ‰
  • Received the Girgensohn Family Endowed Graduate Fellowship πŸ†
  • Finishing up my Autodesk internship.
  • Map2Video and CinemaWorld were accepted to UIST 2026! πŸŽ‰

Timeline

Fine Art 🎨
Film VFX 🎬 Dexter Studios
Immersive ContentΒ πŸ₯½ Dexter Studios
Human-Computer Interaction (HCI) ResearchΒ πŸ“ KAIST, CAU, CU Boulder, Fujitsu, Autodesk
20162018202020222029
Career Education
BFA in Painting & Media ArtΒ πŸŽ“πŸ₯ˆ Seoul National University
MS in Industrial Design (HCI)Β πŸŽ“πŸ† Korea Advanced Institute of Science & Technology (KAIST)
PhD in Computer ScienceΒ πŸŽ“ University of Colorado Boulder (expected)
Career Education
Fine Art 🎨
Film VFX 🎬 Dexter Studios
Immersive ContentΒ πŸ₯½ Dexter Studios
Human-Computer Interaction (HCI) ResearchΒ πŸ“ KAIST, CAU, CU Boulder, Fujitsu, Autodesk
20162018202020222029
BFA in Painting & Media ArtΒ πŸŽ“πŸ₯ˆ Seoul National University
MS in Industrial Design (HCI)Β πŸŽ“πŸ† Korea Advanced Institute of Science & Technology (KAIST)
PhD in Computer ScienceΒ πŸŽ“ University of Colorado Boulder (expected)

Selected Work

Map2Video street-view driven video generation
Map2Video: Guiding Real-World-Grounded AI Video Generation Hye-Young Jo, Mose Sakashita, Aditi Mishra, Ryo Suzuki, Koichiro Niinuma, Aakar Gupta ACM UIST Β· 2026 Map2Video guides AI video generation grounded in street view imagery through map-based character trajectory annotation and direct manipulation of cameras and character masks defined in geodetic coordinates.
Generative Lecture interface with an AI clone instructor
Generative Lecture: Making Lecture Videos Interactive with LLMs and AI Clone Instructors Hye-Young Jo, Ada Zhao, Xiaoan Liu, Ryo Suzuki arXiv Β· 2025 Generative Lecture embeds AI clone instructors into existing lecture videos using LLMs and avatar/voice synthesis, adding on-demand clarification, interactive examples, adaptive quizzes, and personalized explanations.
CollageVis interface showing a layered video collage for previsualization
CollageVis: Rapid Previsualization Tool for Indie Filmmaking using Video Collages Hye-Young Jo, Ryo Suzuki, Yoonji Kim ACM CHI Β· 2024 CollageVis is a rapid previsualization tool that lets indie filmmakers compose scenes from video collages, with automatic actor segmentation, name tags and face swaps, role assignment, layer positioning, and mobile-based virtual camera recording.
FlowAR augmented reality yoga tutorial overlays
FlowAR: How Different Augmented Reality Visualizations of Online Fitness Videos Support Flow for At-Home Yoga Exercises Hye-Young Jo, Laurenz Seidel, Michel Pahud, Mike Sinclair, Andrea Bianchi ACM CHI Β· 2023 FlowAR studies how different AR visualizations of online fitness videos support flow during at-home yoga.
The Tide poster: a diver reflected in a giant fish eye, with festival laurels including Sundance
VR The Tide Dexter Studios Γ— Naver Β· 2020 VR/AR generalist Official Selection, Sundance 2019 New Frontier
Along with the Gods: The Last 49 Days
Along with the Gods: The Last 49 Days Dexter Studios Β· 2018 VFX compositor Best Visual Effects, 2018 Grand Bell AwardsOver 12 million viewers in South Korea
1987: When the Day Comes
1987: When the Day Comes Dexter Studios Β· 2017 VFX compositor Best Film, 2018 Blue Dragon Film AwardsOver 5 million viewers in South Korea
Fabricated City
Fabricated City Dexter Studios Β· 2017 VFX compositor Over 2.5 million viewers in South Korea
Hye-Young mixing a cocktail at the 1:1 Bar
1:1 Bar Live performance A bar for one guest at a time: I talk with an invited fellow artist, then mix a cocktail that works as their portrait, with color, scent, and taste read from who they are.
My Childhood: a 3D pop-up book of the towns I grew up in
My Childhood 3D animation A self-portrait told through how often I moved as a child.
Walking on the Spot wearable device
Walking on the Spot Wearable installation A wearable harness that lets the wearer keep walking but only in place, because lifting one foot pulls the other back.
Story You Cannot Tell: acrylic painting
Story You Cannot Tell Acrylic painting on paper A figure tangled in its own arms, hands pressed over the face, holding in what cannot be said.