Hye-Young Jo

Hi, I'm Hye-Young,

An HCI researcher who came from fine art and film.

I am a PhD student in Computer Science at the University of Colorado Boulder, advised by Prof. Ryo Suzuki in the Programmable Reality Lab at the ATLAS Institute. I also worked as a research intern at Fujitsu and Autodesk.

My research goal is to expand people’s capacity to create and learn by building interactive systems with generative AI and extended reality. This work has been recognized and supported by the Google PhD Fellowship.

Latest News

  • Finishing up my Autodesk internship.
  • Map2Video and CinemaWorld were accepted to UIST 2026! πŸŽ‰
  • Celebrated Haru's first birthday.
  • Joined the Autodesk HCI & Visualization team in Toronto for a summer internship.

Timeline

Fine Art 🎨
Film VFX 🎬 Dexter Studios
Immersive ContentΒ πŸ₯½ Dexter Studios
Human-Computer Interaction (HCI) ResearchΒ πŸ“ KAIST, CAU, CU Boulder, Fujitsu, Autodesk
20162018202020222029
Career Education
BFA in Painting & Media ArtΒ πŸŽ“πŸ₯ˆ Seoul National University
MS in Industrial Design (HCI)Β πŸŽ“πŸ† Korea Advanced Institute of Science & Technology (KAIST)
PhD in Computer ScienceΒ πŸŽ“ University of Colorado Boulder (expected)
Career Education
Fine Art 🎨
Film VFX 🎬 Dexter Studios
Immersive ContentΒ πŸ₯½ Dexter Studios
Human-Computer Interaction (HCI) ResearchΒ πŸ“ KAIST, CAU, CU Boulder, Fujitsu, Autodesk
20162018202020222029
BFA in Painting & Media ArtΒ πŸŽ“πŸ₯ˆ Seoul National University
MS in Industrial Design (HCI)Β πŸŽ“πŸ† Korea Advanced Institute of Science & Technology (KAIST)
PhD in Computer ScienceΒ πŸŽ“ University of Colorado Boulder (expected)

Selected Work

Map2Video street-view driven video generation
Map2Video: Guiding Real-World-Grounded AI Video Generation Hye-Young Jo, Mose Sakashita, Aditi Mishra, Ryo Suzuki, Koichiro Niinuma, Aakar Gupta Map2Video guides AI video generation grounded in street view imagery through map-based character trajectory annotation and direct manipulation of cameras and character masks defined in geodetic coordinates.
Generative Lecture interface with an AI clone instructor
Generative Lecture: Making Lecture Videos Interactive with LLMs and AI Clone Instructors Hye-Young Jo, Ada Zhao, Xiaoan Liu, Ryo Suzuki Generative Lecture embeds AI clone instructors into existing lecture videos using LLMs and avatar/voice synthesis, adding on-demand clarification, interactive examples, adaptive quizzes, and personalized explanations.
CollageVis interface showing a layered video collage for previsualization
CollageVis: Rapid Previsualization Tool for Indie Filmmaking using Video Collages Hye-Young Jo, Ryo Suzuki, Yoonji Kim CollageVis is a rapid previsualization tool that lets indie filmmakers compose scenes from video collages, with automatic actor segmentation, name tags and face swaps, role assignment, layer positioning, and mobile-based virtual camera recording.
FlowAR augmented reality yoga tutorial overlays
FlowAR: How Different Augmented Reality Visualizations of Online Fitness Videos Support Flow for At-Home Yoga Exercises Hye-Young Jo, Laurenz Seidel, Michel Pahud, Mike Sinclair, Andrea Bianchi FlowAR studies how different AR visualizations of online fitness videos support flow during at-home yoga.
Along with the Gods: The Two Worlds
Along with the Gods: The Two Worlds A South Korean fantasy-action film based on the webtoon by Ho-Min Joo.
Along with the Gods: The Last 49 Days
Along with the Gods: The Last 49 Days The sequel to The Two Worlds, based on Ho-Min Joo's webtoon.
1987: When the Day Comes
1987: When the Day Comes A South Korean political drama based on true events.
Kung Fu Yoga
Kung Fu Yoga A Chinese-Indian action-adventure comedy starring Jackie Chan, directed by Stanley Tong.
Hye-Young mixing a cocktail at the 1:1 Bar
1:1 Bar A bar for one guest at a time: I talk with an invited fellow artist, then mix a cocktail that works as their portrait, with color, scent, and taste read from who they are.
Paper Animation: My Childhood
Paper Animation My Childhood: a paper pop-up book that opens, page by page, into the house and playground I grew up in.
Walking on the Spot wearable device
Walking on the Spot A wearable harness that ties the waist to the feet so that lifting one foot pulls the other back: the wearer can keep walking, but only in place.
Story You Cannot Tell: acrylic painting
Story You Cannot Tell Acrylic on canvas: a figure folds in on itself, arms and legs crossing over the face, holding in what cannot be said.