csehong

   Sungeun Hong

    Associate Professor & Photographer  

    AI & Media (AIM) Lab, Sungkyunkwan University

    Web: www.csehong.com

    Email: csehong@skku.edu

    CV · Google Scholar · LinkedIn · GitHub · PhotoBlog  

    Seeking for new members from graduate students to post-doctoral researchers! 

 Work Experience

 Education

 Research Interests

    · Multimodal Learning   · Vision-Language Models   · Domain Transfer   · Robot Vision   · Efficient Transfer Learning

 Publications

Question-Aware Gaussian Experts for Audio-Visual Question Answering

Hongyeob Kim*, Inyoung Jung*, Dayoon Suh, Youjia Zhang, Sangmin Lee and Sungeun Hong, Proc. IEEE/CVF Conference on Computer Vision and Patter Recognition (CVPR 2025), June 2025 (Accepted).  

Multimodal Learning   Audio-Vision-Language  Question Asnwering


Memory-Efficient Cross-Modal Attention for RGB-X Segmentation and Crowd Counting

Youjia Zhang, Soyun Choi, and Sungeun Hong, Pattern Recognition (Q1, JCR: Top 6.9%), January 2025.

Multimodal Learning   Sensor Fusion   Semantic Segmentation   Crowd Counting

[Paper]


Perceptual Metric for Face Image Quality with Pixel-level Interpretability

Byungho Jo, In Kyu Park, and Sungeun Hong, Neurocomputing (Q1), January 2025.

Face   Image Quality Assessment   Image Restoration

[Paper] [Project]

Prototypical Class-wise Test-Time Adaptation

Hojoon Lee, Seunghwan Lee, Inyoung Jung, and Sungeun Hong, Pattern Recognition Letters, January 2025.

Test-time Adaptation   Class Alignment

[Paper]


FVTTS: Face based voice synthesis for text-to-speech

Minyoung Lee, Eunil Park and Sungeun Hong, Proc. Annual Conference of the International Speech Communication Association (INTERSPEECH 2024), September 2024.  

Text-to-Speech (TTS)   Face   Synthesis

[Paper] [Project]

Scale-aware Token-matching for Transformer-based Object Detector

Aecheon Jung, Sungeun Hong, and Yoonsuk Hyun, Pattern Recognition Letters, vol. 185, pp. 197-202, September  2024.

Transformer  Object Detection   Small Object

[Paper]

G-TRACE: Grouped Temporal Recalibration for Video Object Segmentation

Jiyun Kim, Jooho Kim, and Sungeun Hong, Image and Vision Computing (Q1), May  2024.

Video Object Segmentation   Attention   Memory Network

[Paper]

Elastic Modulus Prediction from Indentation Using Machine Learning: Considering Tip Geometric Imperfection

Jong-hyoung Kim, Dong-Yeob Kim, Junsang Lee, Soon Woo Kwon, Jongheon Kim, Seung-Kyun Kang, Sungeun Hong, and Young-Cheon Kim, Metals and Materials International (Q1), March 2024.

Indentation   Elastic Modules

[Paper]

Visual and tactile perception techniques for braille recognition

Byeong-Sun Park, Seong-Min Im, Hojun Lee, Young Tack Lee, Changjoo Nam, Sungeun Hong, and Min-gu Kim, Micro and Nano Systems Letters, vol. 11, no. 1, pp. 1-8, December 2023.

Multimodal Learning   Sensor Fusion   Tactile   Touch   Braille Recognition

[Paper]

Re-Aging GAN++: Temporally consistent transformation of faces in videos

Farkhod Makhmudkhujaev, Sungeun Hong, and In Kyu Park, IEEE Access, vol. 11, pp. 137377-137386, December 2023.

Face   Age Transformation  Video Processing

[Paper]

SegTex: A large scale synthetic face dataset for face recognition

Laudwika Ambardi, Sungeun Hong, and In Kyu Park, IEEE Access, vol. 11, pp. 131939-131949, November 2023.

Face    Synthetic Data  Segmentation

[Paper]

Intra-inter modal attention blocks for RGB-D semantic segmentation

Soyun Choi, Youjia Zhang and Sungeun Hong, Proc. ACM International Conference on Multimedia Retrieval (ICMR 2023) (Oral), June 2023. 

Multimodal Learning   Sensor Fusion   RGB-D   Semantic Segmentation

[Paper] [Project]

TL-ADA: transferable loss-based active domain adaptation

Kyeongtak Han, Youngeun Kim, Dongyoon Han, Hojun Lee, and Sungeun Hong, Neural Networks (Q1, JCR: Top 9.4%), February 2023. 

Active Domain Adaptation   Active Learning   Learning Loss

[Paper

IFQA: Interpretable face quality assessment

Byungho Jo, Donghyeon Cho, In Kyu Park, and Sungeun Hong, Proc. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2023), pp.3444-3453, January 2023

Face   Image Quality Assessment   Image Restoration

[Paper] [Project]

Spatio-channel attention blocks for cross-modal crowd counting

Youjia Zhang, Soyun Choi, and Sungeun Hong, Proc. Asian Conference on Computer Vision (ACCV 2022) (Oral), December 2022.

Multimodal Learning    Sensor Fusion   RGB-D/T Crowd Counting

[Paper] [Project]

Adaptive graph adversarial networks for partial domain adaptation

Youngeun Kim and Sungeun Hong, IEEE Trans. on Circuits and Systems for Video Technology (Q1, JCR: Top 5.5%), vol. 32, no. 1, pp. 172-182, January 2022.

Domain Adaptation   Graph Neural Networks

[Paper

Re-Aging GAN: Toward personalized face age transformation

Farkhod Makhmudkhujaev, Sungeun Hong, and In Kyu Park, Proc. IEEE/CVF International Conference on Computer Vision (ICCV 2021), October 2021.

Face    Age Estimation  GAN

[Paper]

Domain adaptation without source data

Youngeun Kim, Donghyeon Cho, Kyeongtak Han, Priyadarshini Panda, and Sungeun Hong, IEEE Trans. on Artificial Intelligence (TAI), vol. 2, no. 6, pp. 508-518, December 2021.

Domain Adaptation   Privacy   Source-Free

[Paper

Self-supervised feature enhancement networks for small object detection in noisy images

Geonsoo Lee, Sungeun Hong (co-first author), and Donghyeon Cho, IEEE Signal Processing Letters, vol. 28, pp. 1026-1030, May 2021.

Object Detection   Small Object   Self-Supervised Learning

[Paper

Towards privacy-preserving domain adaptation

Youngeun Kim, Donghyeon Cho, and Sungeun Hong, IEEE Signal Processing Letters, vol. 27, pp. 1675-1679, September 2020.

Domain Adaptation   Privacy

[Paper

Attention-guided adaptation factors for unsupervised facial domain adaptation

Sungeun Hong and Jongbin Ryu, Electronics Letters, vol. 56, no. 16, pp. 816-818, August 2020.

 Domain Adaptation   Attention

[Paper

Unsupervised face domain transfer for low-resolution face recognition

Sungeun Hong and Jongbin Ryu, IEEE Signal Processing Letters, vol. 27, pp. 156-160, December 2019.

Face   Domain Adaptation   Low-Resolution

[Paper]

VisDrone-DET2019: The vision meets drone object detection in image challenge results

Sungeun Hong and VisDrone Challenge Participants, VisDrone Workshops at International Conference on Computer Vision (ICCVW 2019), October 2019.
3rd Prize in Vision Meets Drone: A Challenge at ICCV '19 

Object Detection   Drone  

[Paper

Patch-level augmentation for object detection in aerial images

Sungeun Hong, Sungil Kang, Donghyeon Cho, VisDrone Workshops at International Conference on Computer Vision (ICCVW 2019), Ranked 3rd, October 2019
3rd Prize in Vision Meets Drone: A Challenge at ICCV '19

Object Detection   Drone   Text-driven Augmentation

[Paper]  [Demo1] [Demo2]

Key instance selection for unsupervised video object segmentation

Sungeun Hong, Donghyeon Cho, Sungil Kang, and Jiwon Kim, DAVIS Challenge Workshops at Computer Vision and Pattern Recognition (CVPRW 2019), Ranked 3rd, June 2019
3rd Prize in DAVIS Challenge on Video Object Segmentation at CVPR '19

Video Object Segmentation   Instance Selection

[Paper] [Poster]

Doubly Nested Network for Resource-Efficient Inference

Jaehong Kim, Sungeun Hong, Yongseok Choi, and Jiwon Kim, arxiv, June 2018.

Model Architecture    Resourse-Efficient

[Paper]

Scale-varying triplet ranking with classification loss for facial age estimation

Woobin Im, Sungeun Hong , Sung-Eui Yoon, and Hyun S. Yang, Proc. Asian Conference on Computer Vision (ACCV 2018), December 2018.

Face   Age Estimation   Ranking Loss

[Paper] [Project]

Cascaded pyramid network for 3D human pose estimation challenge

Sungeun Hong , Wonjin Jung, Ilsang Woo, and Seung Wook Kim, PoseTrack Workshops at European Conference on Computer Vision (ECCVW 2018), September 2018.

Human Pose Estimation   Pyramid Network

[Paper

Bilinear attention networks for VizWiz challenge

Jin-Hwa Kim, Yongseok Choi, Sungeun Hong, Jaehyun Jun, and Byoung-Tak Zhang, Vizwiz Workshops at European Conference on Computer Vision (ECCVW 2018), Ranked 2nd, September 2018.
2nd Prize in VizWiz Grand challenge at ECCV '18 

Visual Question Answering   Attention   Visually Impaired

[Paper]  [Slides]  [Poster]

CBVMR: Content-based video–music retrieval using soft intra-modal structure constraint

Sungeun Hong , Woobin Im, and Hyun S. Yang, Proc. ACM International Conference on Multimedia Retrieval (ICMR 2018) (spotlight), June 2018.

Multimodal Learning   Cross-modal Retrieval   Video Object Segmentation   Music

[Paper] [Poster]  [Demo]

D3: Recognizing dynamic scenes with deep dual descriptor based on key frames and key segments

Sungeun Hong, Jongbin Ryu, Woobin Im, and Hyun S. Yang, Neurocomputing (Q1), vol. 273, pp. 611-621, January 2018.

Dynamic Scene   Dynamic Texture   Key Frame

[Paper]  [Slides]  [Dataset

Not all frames are equal: aggregating salient features for dynamic texture classification

Sungeun Hong, Jongbin Ryu, and Hyun S. Yang, Multidimensional Systems and Signal Processing, vol. 29, pp. 279-298, January 2018.

Dynamic Texture   Feature Aggregation

[Paper]  [Slides

SSPP-DAN: Deep domain adaptation network for face recognition with single sample per person

Sungeun Hong, Woobin Im, Jongbin Ryu, and Hyun S. Yang, IEEE International Conference on Image Processing (ICIP 2017) (Oral), September 2017.

Domain Adaptation   Face Recognition   

[Paper]  [Slides]  [Dataset] [Lecture]

Sorted consecutive local binary pattern for texture classification

Jongbin Ryu, Sungeun Hong, and Hyun S. Yang, IEEE Trans. on Image Processing (Q1, JCR: Top 2.3%), vol. 24, no. 7, pp. 2254-2265, July 2015.

Texture Classification   LBP   Rotation Invariant

[Paper]

Recursive Bayesian fire recognition using greedy margin-maximizing clustering

Sujung Bae, Sungeun Hong, Yeongjae Choi, and Hyun S. Yang, Machine Vision and Applications, vol. 24, pp. 1605-1621, November 2013. 

Fire Recognition   Bayesian   Clustering

[Paper]

3D Keypoint Tracking Based on Hybrid Flow Computation for Human Motion Analysis

Sujung Bae, Sungeun Hong, and Hyun S. Yang, Machine Vision and Applications (MVA 2013), IAPR, May 2013.

Tracking  3D Keypoint   Human Motion

[Paper]

 Research Projects

Ongoing

Completed

 Academic Activities


  Honors & Awards