
Email: hye-young.jo@colorado.edu
Google Scholar | LinkedIn | GitHub | X.com | Instagram
Hi, I'm Hye-Young,
I am a Ph.D. student in Computer Science at the University of Colorado Boulder, advised by Prof. Ryo Suzuki in the Programmable Reality Lab at the ATLAS Institute.
My research explores how generative AI and extended reality can enable embodied learning and creative living. My work has been recognized and supported by Google Ph.D. Fellowship.
I completed my B.F.A. in Painting and Media Arts at Seoul National University and my M.S. in Industrial Design at KAIST, where I was advised by Prof. Andrea Bianchi in the MAKE Lab. I have also worked as a film VFX compositor and XR generalist at Dexter Studios and as a research intern at Fujitsu Converging Lab.
LATEST NEWS
January 16, 2026
CHI26
TingleTouch paper got conditionally accepted to the CHI conference
December 4, 2025
Ralph J. Slutz Student Excellence Award
Grateful to be recognized with this academic excellence award 🏆
October 23, 2025
Google Ph.D. Fellowship
Honored to receive the Google PhD Fellowship in Human–Computer Interaction 🏆
October 2, 2025
Invited talk at Fujitsu
I gave a talk at Fujitsu Research of America on the interaction of AI-driven video generation.
PUBLICATION
✧ Research interests: Human-Computer Interaction; Human-AI Interaction; Creativity Support Tools; Generative Agents; AI-driven Content Adaptation; Embodied AI; XR Interaction; Augmented Instruction

TingleTouch
CHI'26
TingleTouch: Touch Guidance through Electrical Stimulation in Resistance Training
Dong-Uk Kim, Hye-Young Jo, Hankyung Kim, Ryo Suzuki, Seungwoo Je, Yoonji Kim.
To appear

Generative Lecture
arXiv'25
Generative Lecture: Making Lecture Videos Interactive with LLMs and AI Clone Instructors
Hye-Young Jo, Ada Zhao, Xiaoan Liu, Ryo Suzuki

Map2Video
arXiv'25
Map2Video: Street View Imagery Driven AI Video Generation
Hye-Young Jo, Mose Sakashita, Aditi Mishra, Ryo Suzuki, Koichiro Niinuma, Aakar Gupta

VR Avatar Body Deformation
ISMAR'25 (TVCG)
Designing Hand and Forearm Gestures to Control Virtual Forearm for User-Initiated Forearm Deformation
Yilong Lin, Han Shi, Weitao Jiang, Xuesong Zhang, Hye-Young Jo, Yoonji Kim, Seungwoo Je
acceptance rate: 7.86 %

CollageVis
CHI’24
CollageVis: Rapid Previsualization Tool for Indie Filmmaking using Video Collages
Hye-Young Jo, Ryo Suzuki, Yoonji Kim.
acceptance rate: 26.4%

TrainerTap
UIST'23 Adjunct
TrainerTap: Weightlifting Support System Prototype Simulating Personal Trainer's Tactile and Auditory Guidance
Hye-Young Jo, Chan Hu Wie, Yejin Jang, Dong-Uk Kim, Yurim Son, Yoonji Kim.
acceptance rate: 21.0%

FlowAR
CHI’23
FlowAR: How Different Augmented Reality Visualizations of Online Fitness Videos Support Flow for At-Home Yoga Exercises
Hye-Young Jo, Laurenz Seidel, Michel Pahud, Mike Sinclair, and Andrea Bianchi.
acceptance rate: 27.6%

Physical Computing Metaverse
HCIK'22
Design of Virtual Reality Application for Interaction Prototyping Remote Education
Hye-Young Jo, Wooje Chang, Hoonjin Jung, Andrea Bianchi.
🏆 Best Paper Award

GamesBond
CHI'21
GamesBond: Bimanual Haptic Illusion of Physically Connected Objects for Immersive VR Using Grip Deformation
Neung Ryu, Hye-Young Jo, Michel Pahud, Mike Sinclair, Andrea Bianchi.
🏅 Honorable Mention Award
UX

KARE MCM
Korea Aid for Respiratory Epidemic: Mobile Clinic Module
KAIST, UNIST, TU Korea, Zoslee Studio, K-Arts, 20PLUS, Inition
KARE MCM (Korea Aid for Respiratory Epidemic: Mobile Clinic Module) is a mobile expandable negative pressure ward with advanced medical facilities developed to cope with an infectious disease outbreak. I was a junior researcher in a research team led by Prof. Tek-Jin Nam and desinged information architecture of user interface.
🏆 iF DESIGN AWARD 2021, Winner
🏆 IDEA Design Award 2021, Bronze

FigureOUT
FigureOUT: A Personalized Tool for Summarizing and Visualizing Academic Literature
Hye-Young Jo*, Minha Lee*, Wooseok Kim*, Yeonsoo Kim*
Working out alone at the gym often lacks the quality and intensity of exercises compared to the training session with a personal trainer. To narrow this gap, we introduce TrainerTap, which simulates the personal trainer's presence during solitary weightlifting workouts. TrainerTap replicates the trainer's manual interventions of tapping the trainee's body parts to capture their attention on target muscles and provides auditory guidance to support executing the movements at a consistent tempo.
-

Meta-Boxing
Meta-Boxing: VR Boxing Game with Controllable Physics-based Character in Third-Person Perspective
Jungjin Park*, Hye-Young Jo*
Online fitness video tutorials are an increasingly popular way to stay fit at home without a personal trainer. However, to keep the screen playing the video in view, users typically disrupt their balance and break the motion flow --- two main pillars for the correct execution of yoga poses. While past research partially addressed this problem, these approaches supported only a limited view of the instructor and simple movements. To enable the fluid execution of complex full-body yoga exercises, we propose FlowAR, an augmented reality system for home workouts that shows training video tutorials as always-present virtual static and dynamic overlays around the user. We tested different overlay layouts in a study with 16 participants, using motion capture equipment for baseline performance. Then, we iterated the prototype and tested it in a furnished lab simulating home settings with 12 users. Our results highlight the advantages of different visualizations and the system's general applicability.
🏆 Excellence Award, Korea Metaverse Developer Contest 2021
🏅 Top Research Award, 2022 Joint Seminar (SNU-KAIST-Sogang-Korea University)