Avatar

Jihyun Lee

Ph.D. Candidate

School of Computing, KAIST


CV | Google Scholar | GitHub


Hello! 👋 I am a last-year Ph.D. student at KAIST advised by Tae-Kyun (T-K) Kim and Minhyuk Sung. In 2024, I was fortunate to visit Meta Reality Labs as a research scientist intern, hosted by Jason Saragih. The goal of my research is to enable artificial intelligence to visually understand and simulate ourselves and our interactions with the environment. Lately, my focus has been on reconstructing and generating hand interactions, but my research interests are not limited to that. 🙂

Contact

  • jyun.lee [at] kaist.ac.kr

  • N1 523, 291 Daehak-ro, Yuseong-gu, Daejeon, Korea, 34141

Education

  • Integrated Master's & Ph.D in Computer Science, KAIST

    Sep. 2020 - Current

  • B.S. in Computer Science, Handong Global University

    Mar. 2017 - Aug. 2020

    - Top Rank in CS/EE Department (GPA: 4.45 / 4.5)

    - Early Graduation

Publications

    * Full publication list (including domestic publications) is available in my CV.

  • REWIND: Real-Time Egocentric Whole-Body Motion Diffusion with Exemplar-Based Identity Conditioning

    Jihyun Lee, Weipeng Xu, Alexander Richard, Shih-En Wei, Shunsuke Saito, Shaojie Bai, Te-Li Wang, Minhyuk Sung, Tae-Kyun (T-K) Kim, Jason Saragih

    CVPR 2025

    [Project] [Paper]

  • Dense Hand-Object(HO) GraspNet with Full Grasping Taxonomy and Dynamics

    Woojin Cho, Jihyun Lee, ...(8 more authors)..., Tae-Kyun (T-K) Kim

    ECCV 2024

    [Project] [Paper] [Code]

  • InterHandGen: Two-Hand Interaction Generation via Cascaded Reverse Diffusion

    Jihyun Lee, Shunsuke Saito, Giljoo Nam, Minhyuk Sung, Tae-Kyun (T-K) Kim

    CVPR 2024

    [Project] [Paper] [Code]

  • FourierHandFlow: Neural 4D Hand Representation Using Fourier Query Flow

    Jihyun Lee, Junbong Jang, Donghwan Kim, Minhyuk Sung, Tae-Kyun (T-K) Kim

    NeurIPS 2023

    [Project] [Paper] [Code]

  • Im2Hands: Learning Attentive Implicit Representation of Interacting Two-Hand Shapes

    Jihyun Lee, Minhyuk Sung, Honggyu Choi, Tae-Kyun (T-K) Kim

    CVPR 2023

    [Project] [Paper] [Code] [Presentation] [Poster]

  • Contrastive Knowledge Distillation for Anomaly Detection in Multi-Illumination/Focus Display Images

    Hangil Park*, Jihyun Lee*, Yongmin Seo, Taewon Min, Joodong Yun, Jaewon Kim, Tae-Kyun (T-K) Kim (* equal contributions)

    MVA 2023 (oral)
    Writen as a report of an industrial research project with Samsung Display

    [Paper]

  • Pop-Out Motion: 3D-Aware Image Deformation via Learning Shape Laplacian

    Jihyun Lee*, Minhyuk Sung*, Hyunjin Kim, Tae-Kyun (T-K) Kim (* equal contributions)

    CVPR 2022

    [Project] [Paper] [Code] [Presentation] [Poster]

  • Face Parsing from RGB and Depth Using Cross-Domain Mutual Learning

    Jihyun Lee, Binod Bhattarai, Tae-Kyun (T-K) Kim

    CVPRW 2021 (oral) - IEEE AMFG acceptance rate: 27%

    [Paper] [Dataset]

  • Fast DCTTS: Efficient Deep Convolutional Text-to-Speech

    Minsu Kang, Jihyun Lee, Simin Kim, Injung Kim

    ICASSP 2021

    [Paper]

Awards & Honors

  • Outstanding Reviewer 2024, ECCV
  • Outstanding TA Award 2022, KAIST
    • - Awarded to TAs who earned the highest ratings on KAIST CS student survey
  • Excellence Award (Mayoral Award) at Korea Software Convergence Hackathon 2019, Ministry of Science and ICT of Korea
    • - Developed an automatic traffic light control system based on reinforcement learning
  • Honorable Mention Award at Undergraduate Student Paper Competition 2019, Korea Software Congress (KSC) and Korea Computer Congress (KCC)
    • - Proposed a method to reduce the blocking effects of DCT-based X-ray grid line suppression techniques
  • Silver Prize at Undergraduate Student Paper Competition 2018, Korea Information Processing Society (KIPS)
    • - Proposed a DCT-based X-ray grid line suppression method using dynamic segmentation

Patent

  • Method for Lightweight Speech Synthesis of End-to-End DCTTS, KR Patent 10-2019-0, 157, 185

Academic Activities

Reviewer

  • CVPR, CVPR Workshops
  • NeurIPS
  • ICCV
  • ECCV
  • ICML
  • AAAI
  • IJCV
  • Pacific Graphics
  • Image and Vision Computing (Elsevier Journal)

Student Organizer

Teaching Experiences

  • Teaching Assistant, Artificial Intelligence and Machine Learning, 2021-2023, KAIST
  • Teaching Assistant, Machine Learning for Computer Vision, 2021-2022, KAIST
  • Teaching Assistant, Operating System, 2020, Handong Global University
  • Teaching Assistant, C++ Programming, 2019, Handong Global University
  • Teaching Assistant, Data Structure, 2018, Handong Global University