Hye-Young Jo

Hi, I'm Hye-Young,

An HCI researcher who came from fine art and film.

I am a PhD student in Computer Science at the University of Colorado Boulder, advised by Prof. Ryo Suzuki in the Programmable Reality Lab at the ATLAS Institute. I also worked as a research intern at Fujitsu and Autodesk.

My research goal is to expand people’s capacity to create and learn by building interactive systems with generative AI and extended reality. This work has been recognized and supported by the Google PhD Fellowship.

News

  • Finished up my Autodesk internship.
  • Map2Video and CinemaWorld were accepted to UIST 2026! πŸŽ‰
  • Celebrated Haru's first birthday.
  • Joined the Autodesk HCI & Visualization team in Toronto for a summer internship πŸ‡¨πŸ‡¦

Timeline

Fine Art 🎨
Film VFX 🎬 Dexter Studios
Immersive ContentΒ πŸ₯½ Dexter Studios
Human-Computer Interaction (HCI) ResearchΒ πŸ“ KAIST, CAU, CU Boulder, Fujitsu, Autodesk
20162018202020222029
Career Education
BFA in Painting & Media ArtΒ πŸŽ“πŸ₯ˆ Seoul National University
MS in Industrial Design (HCI)Β πŸŽ“πŸ† Korea Advanced Institute of Science & Technology (KAIST)
PhD in Computer ScienceΒ πŸŽ“ University of Colorado Boulder (expected)
Career Education
Fine Art 🎨
Film VFX 🎬 Dexter Studios
Immersive ContentΒ πŸ₯½ Dexter Studios
Human-Computer Interaction (HCI) ResearchΒ πŸ“ KAIST, CAU, CU Boulder, Fujitsu, Autodesk
20162018202020222029
BFA in Painting & Media ArtΒ πŸŽ“πŸ₯ˆ Seoul National University
MS in Industrial Design (HCI)Β πŸŽ“πŸ† Korea Advanced Institute of Science & Technology (KAIST)
PhD in Computer ScienceΒ πŸŽ“ University of Colorado Boulder (expected)

Recent Projects

All work β†’
Map2Video street-view driven video generation
Map2Video: Guiding Real-World-Grounded AI Video Generation Map2Video guides AI video generation grounded in street view imagery through map-based character trajectory annotation and direct manipulation of cameras and character masks defined in geodetic coordinates.
A viewer in a Quest 3 watching a movie while the room is augmented with matching 3D content
CinemaWorld: Generative Augmented Reality with LLMs and 3D Scene Generation for Movie Augmentation CinemaWorld is a generative augmented reality system that augments the viewer's physical surroundings with mixed reality 3D content extracted from and synchronized with a movie.
TingleTouch electrical stimulation guidance during weight training
TingleTouch: Touch Guidance through Electrical Stimulation in Resistance Training TingleTouch uses electrical muscle stimulation to recreate a personal trainer's touch guidance during resistance training.
Generative Lecture interface with an AI clone instructor
Generative Lecture: Making Lecture Videos Interactive with LLMs and AI Clone Instructors Generative Lecture embeds AI clone instructors into existing lecture videos using LLMs and avatar/voice synthesis, adding on-demand clarification, interactive examples, adaptive quizzes, and personalized explanations.