csehong
Sungeun Hong
Associate Professor & Photographer
AI & Media (AIM) Lab, Sungkyunkwan University
Web: www.csehong.com
Email: csehong@skku.edu
CV · Google Scholar · LinkedIn · GitHub · PhotoBlog
Seeking for new members from graduate students to post-doctoral researchers!
Work Experience
Sungkyunkwan University, Associate Professor, 2023.09 - Present
Dept. of Immersive Media Engineering / School of Convergence
College of Computing and InformaticsInha University, Assistant Professor, 2020.09 - 2023.08
Dept. of Information and Communication EngineeringSK telecom, Research Scientist, 2018.01 - 2020.08
T-Brain, AI Center
Education
KAIST, Ph.D., Computer Science, 2018
KAIST, M.S., Computer Science, 2012
Hanyang, B.S., Computer Engineering, 2010
Research Interests
· Multimodal Learning · Vision-Language Models · Domain Transfer · Robot Vision · Efficient Transfer Learning
Publications
Question-Aware Gaussian Experts for Audio-Visual Question Answering
Hongyeob Kim*, Inyoung Jung*, Dayoon Suh, Youjia Zhang, Sangmin Lee and Sungeun Hong, Proc. IEEE/CVF Conference on Computer Vision and Patter Recognition (CVPR 2025), June 2025 (Accepted).
Multimodal Learning Audio-Vision-Language Question Asnwering
Memory-Efficient Cross-Modal Attention for RGB-X Segmentation and Crowd Counting
Youjia Zhang, Soyun Choi, and Sungeun Hong, Pattern Recognition (Q1, JCR: Top 6.9%), January 2025.
Multimodal Learning Sensor Fusion Semantic Segmentation Crowd Counting
[Paper]
Prototypical Class-wise Test-Time Adaptation
Hojoon Lee, Seunghwan Lee, Inyoung Jung, and Sungeun Hong, Pattern Recognition Letters, January 2025.
Test-time Adaptation Class Alignment
[Paper]
Scale-aware Token-matching for Transformer-based Object Detector
Aecheon Jung, Sungeun Hong, and Yoonsuk Hyun, Pattern Recognition Letters, vol. 185, pp. 197-202, September 2024.
Transformer Object Detection Small Object
[Paper]
G-TRACE: Grouped Temporal Recalibration for Video Object Segmentation
Jiyun Kim, Jooho Kim, and Sungeun Hong, Image and Vision Computing (Q1), May 2024.
Video Object Segmentation Attention Memory Network
[Paper]
Elastic Modulus Prediction from Indentation Using Machine Learning: Considering Tip Geometric Imperfection
Jong-hyoung Kim, Dong-Yeob Kim, Junsang Lee, Soon Woo Kwon, Jongheon Kim, Seung-Kyun Kang, Sungeun Hong, and Young-Cheon Kim, Metals and Materials International (Q1), March 2024.
Indentation Elastic Modules
[Paper]
Visual and tactile perception techniques for braille recognition
Byeong-Sun Park, Seong-Min Im, Hojun Lee, Young Tack Lee, Changjoo Nam, Sungeun Hong, and Min-gu Kim, Micro and Nano Systems Letters, vol. 11, no. 1, pp. 1-8, December 2023.
Multimodal Learning Sensor Fusion Tactile Touch Braille Recognition
[Paper]
Re-Aging GAN++: Temporally consistent transformation of faces in videos
Farkhod Makhmudkhujaev, Sungeun Hong, and In Kyu Park, IEEE Access, vol. 11, pp. 137377-137386, December 2023.
Face Age Transformation Video Processing
[Paper]
SegTex: A large scale synthetic face dataset for face recognition
Laudwika Ambardi, Sungeun Hong, and In Kyu Park, IEEE Access, vol. 11, pp. 131939-131949, November 2023.
Face Synthetic Data Segmentation
[Paper]
TL-ADA: transferable loss-based active domain adaptation
Kyeongtak Han, Youngeun Kim, Dongyoon Han, Hojun Lee, and Sungeun Hong, Neural Networks (Q1, JCR: Top 9.4%), February 2023.
Active Domain Adaptation Active Learning Learning Loss
[Paper]
Adaptive graph adversarial networks for partial domain adaptation
Youngeun Kim and Sungeun Hong, IEEE Trans. on Circuits and Systems for Video Technology (Q1, JCR: Top 5.5%), vol. 32, no. 1, pp. 172-182, January 2022.
Domain Adaptation Graph Neural Networks
[Paper]
Re-Aging GAN: Toward personalized face age transformation
Farkhod Makhmudkhujaev, Sungeun Hong, and In Kyu Park, Proc. IEEE/CVF International Conference on Computer Vision (ICCV 2021), October 2021.
Face Age Estimation GAN
[Paper]
Domain adaptation without source data
Youngeun Kim, Donghyeon Cho, Kyeongtak Han, Priyadarshini Panda, and Sungeun Hong, IEEE Trans. on Artificial Intelligence (TAI), vol. 2, no. 6, pp. 508-518, December 2021.
Domain Adaptation Privacy Source-Free
[Paper]
Self-supervised feature enhancement networks for small object detection in noisy images
Geonsoo Lee, Sungeun Hong (co-first author), and Donghyeon Cho, IEEE Signal Processing Letters, vol. 28, pp. 1026-1030, May 2021.
Object Detection Small Object Self-Supervised Learning
[Paper]
Towards privacy-preserving domain adaptation
Youngeun Kim, Donghyeon Cho, and Sungeun Hong, IEEE Signal Processing Letters, vol. 27, pp. 1675-1679, September 2020.
Domain Adaptation Privacy
[Paper]
Attention-guided adaptation factors for unsupervised facial domain adaptation
Sungeun Hong and Jongbin Ryu, Electronics Letters, vol. 56, no. 16, pp. 816-818, August 2020.
Domain Adaptation Attention
[Paper]
Unsupervised face domain transfer for low-resolution face recognition
Sungeun Hong and Jongbin Ryu, IEEE Signal Processing Letters, vol. 27, pp. 156-160, December 2019.
Face Domain Adaptation Low-Resolution
[Paper]
VisDrone-DET2019: The vision meets drone object detection in image challenge results
Sungeun Hong and VisDrone Challenge Participants, VisDrone Workshops at International Conference on Computer Vision (ICCVW 2019), October 2019.
3rd Prize in Vision Meets Drone: A Challenge at ICCV '19
Object Detection Drone
[Paper]
Patch-level augmentation for object detection in aerial images
Sungeun Hong, Sungil Kang, Donghyeon Cho, VisDrone Workshops at International Conference on Computer Vision (ICCVW 2019), Ranked 3rd, October 2019
3rd Prize in Vision Meets Drone: A Challenge at ICCV '19
Object Detection Drone Text-driven Augmentation
Key instance selection for unsupervised video object segmentation
Sungeun Hong, Donghyeon Cho, Sungil Kang, and Jiwon Kim, DAVIS Challenge Workshops at Computer Vision and Pattern Recognition (CVPRW 2019), Ranked 3rd, June 2019
3rd Prize in DAVIS Challenge on Video Object Segmentation at CVPR '19
Video Object Segmentation Instance Selection
Doubly Nested Network for Resource-Efficient Inference
Jaehong Kim, Sungeun Hong, Yongseok Choi, and Jiwon Kim, arxiv, June 2018.
Model Architecture Resourse-Efficient
[Paper]
Cascaded pyramid network for 3D human pose estimation challenge
Sungeun Hong , Wonjin Jung, Ilsang Woo, and Seung Wook Kim, PoseTrack Workshops at European Conference on Computer Vision (ECCVW 2018), September 2018.
Human Pose Estimation Pyramid Network
[Paper]
Bilinear attention networks for VizWiz challenge
Jin-Hwa Kim, Yongseok Choi, Sungeun Hong, Jaehyun Jun, and Byoung-Tak Zhang, Vizwiz Workshops at European Conference on Computer Vision (ECCVW 2018), Ranked 2nd, September 2018.
2nd Prize in VizWiz Grand challenge at ECCV '18
Visual Question Answering Attention Visually Impaired
CBVMR: Content-based video–music retrieval using soft intra-modal structure constraint
Sungeun Hong , Woobin Im, and Hyun S. Yang, Proc. ACM International Conference on Multimedia Retrieval (ICMR 2018) (spotlight), June 2018.
Multimodal Learning Cross-modal Retrieval Video Object Segmentation Music
SSPP-DAN: Deep domain adaptation network for face recognition with single sample per person
Sungeun Hong, Woobin Im, Jongbin Ryu, and Hyun S. Yang, IEEE International Conference on Image Processing (ICIP 2017) (Oral), September 2017.
Domain Adaptation Face Recognition
Sorted consecutive local binary pattern for texture classification
Jongbin Ryu, Sungeun Hong, and Hyun S. Yang, IEEE Trans. on Image Processing (Q1, JCR: Top 2.3%), vol. 24, no. 7, pp. 2254-2265, July 2015.
Texture Classification LBP Rotation Invariant
[Paper]
Recursive Bayesian fire recognition using greedy margin-maximizing clustering
Sujung Bae, Sungeun Hong, Yeongjae Choi, and Hyun S. Yang, Machine Vision and Applications, vol. 24, pp. 1605-1621, November 2013.
Fire Recognition Bayesian Clustering
[Paper]
3D Keypoint Tracking Based on Hybrid Flow Computation for Human Motion Analysis
Sujung Bae, Sungeun Hong, and Hyun S. Yang, Machine Vision and Applications (MVA 2013), IAPR, May 2013.
Tracking 3D Keypoint Human Motion
[Paper]
Research Projects
Ongoing
신뢰가능하고 안전한 인간-AI 정렬기술 연구개발
Development of Reliable, Secure, and Safe Human-AI Alignment Techniques (2024.07 ~ 2026.12)거대 언어 모델의 정신건강 분야 적용 시 발생할 수 있는 정렬 오류 문제와 로봇 인공지능 기술에서 발생할 수 있는 정렬 오류에 초점을 맞추어, 이들 오류에 대응하기 위한 기술 개발 방안을 탐구
Funded by Institute for Information & communications Technology Promotion (IITP) (정보통신기획평가원 디지털분야글로벌연구지원사업)
지능형멀티미디어연구센터 / 메타버스융합대학원사업
Center for Multimedia Intelligence / Metaverse Convergence Graduate School (2023.09 ~ 2029.08)실감형 메타버스 ICT기술과 문화/영상 콘텐츠 기술을 선도하는 기업친화적이며 융합적인 글로벌 리딩 메타버스 전문가 양성
Funded by Institute for Information & communications Technology Promotion (IITP) (정보통신기획평가원 메타버스융합대학원 지원사업)
RGB-X 데이터의 다중-모달 다수-작업 학습을 위한 경로 네트워크 기술
RGB-X Path Networks for Multi-modal Multi-task Learning (2023.03 ~ 2026.02)RGB 이미지와 선택적으로 주어지는 정보(깊이, 열화상, 촉각, 텍스트 등)를 효율적으로 융합하고, 서로 다른 작업 및 환경간의 지식 전이를 통합적으로 수행할 수 있는 RGB-X 데이터의 다중-모달 다수-작업 학습을 위한 경로 네트워크 기술을 연구
Funded by National Research Foundation (한국연구재단 이공분야기초연구사업 - 우수신진연구)
인공지능 융합형 메타휴먼 플랫폼 연구실
Artificial Intelligence Convergence Meta-Human Platform Lab (2022.06 ~ 2025.02)다양한 메타버스 응용분야에 활용할 수 있는 가상 인간모델(메타휴먼) 생성의 기반기술을 연구하고 인간의 외형 뿐 아니라 물리적, 생리적, 심리적 특성들을 표현하고 외부 객체들과 인터랙션 할 수 있는 메타버스 플랫폼 기술을 연구
Funded by National Research Foundation (한국연구재단 기초연구실 지원사업)
Completed
인공지능 반도체 융합연구센터 (link)
Artificial Intelligence Semiconductor Convergence Research Center (2022.03 ~ 2025.12)인공지능 알고리즘 및 시스템반도체 설계의 지식을 갖춘 전문 인력을 목표로 함
Funded by National Research Foundation (시스템 반도체 융합전문인력 양성센터)
멀티모달리티 융합을 통한 RGB-D 객체 검출 및 분할 기술
RGB-D Object Detection and Segmentation based on Multimodal Fusion (2023.03 ~ 2023.10)로봇이 특정 물체를 자동으로 인식하고 조작하기 위해서 RGB 영상외에도 깊이 정보를 효율적으로 융합하는 객체 검출 및 분할 프레임워크 개발
Funded by Samsung Electronics (삼성전자 생산기술연구소)
동적 질량중심을 가지며 변형 가능한 물체를 인간 수준으로 조작하기 위한 시-촉각 인식 기술
Visuo-Tactile Perception for Human-Like Manipulation of Deformable Objects with Dynamic Center of Mass (2021.09 ~ 2023.08)본 과제는 로봇이 인간 수준으로 물체를 조작하기 위한, “시-촉각 융합” 및 “시-촉각 인식을 통한 연성 변형 물체의 안정적 파지 및 매니퓰레이션 원천 기술 개발을 목표로 함
Funded by Samsung Research Funding & Incubation Center for Future Technology (삼성미래기술 육성사업)
BK21 산업융합형 차세대 인공지능 혁신인재 교육연구단 (link)
BK21 Education and Research Group for Industrial Convergence Next-Generation AI Innovation Talents (2020.09 ~ 2027.08)4단계 BK21 사업에 참여하며, 국내 최고 수준의 인공지능 분야 글로벌 리더를 양성하고 유기적인 인공지능 특화 산학협력 시스템을 구축하는 것을 목표로 함
Funded by National Research Foundation (교육부 4단계 BK21 사업)
인공지능융합연구센터/ 인공지능융합혁신대학원사업 (link)
AI Convergence Research Center / AI Convergence Innovation Graduate School Project(2020.04 ~ 2025.12)과기정통부 인공지능대학원 프로그램에 참여하는 인천지역 최초의 인공지능분야 특화 연구, 교육기관으로서, 인공지능 핵심 기술 연구개발 및 다양한 산업분야에 인공지능 기술을 확산하기 위한 인공지능 인재양성과 기술확산
Funded by Institute for Information & communications Technology Promotion (IITP) (정보통신기획평가원 인공지능융합연구센터/인공지능융합혁신대학원 지원사업)
데이터 프라이버시를 보호가능한 도메인 적응 기반 영상 분류 및 분할
Image Classification and Segmentation based on Data Privacy-Preserving Domain Adaptation (2021.06 ~ 2023.02)학습 과정에서 소스 도메인의 데이터를 직접 사용하지 않고, 소스 도메인으로부터 기학습된 모델과 타겟 도메인 데이터간의 도메인 적응을 수행할 수 있는 기술을 확보
Funded by National Research Foundation (한국연구재단 이공분야기초연구사업 - 기본연구)
Academic Activities
Reviewer
Conference on Computer Vision and Patter Recognition (CVPR)
International Conference on Computer Vision (ICCV)
European Conference on Computer Vision (ICCV)
Neural Information Processing Systems (NeurIPS)
International Conference on Machine Learning (ICML)
International Conference on Learning Representations
Advancement of Artificial Intelligence (AAAI)
Honors & Awards
Encouragement Prize, AI Signal Processing Conference, Oct 2024
Best Paper Award at The 25th Korean MEMS Conference, March 2023
Outstanding Young Researcher Award from the Korea Broadcasting and Media Engineering Society (한국방송·미디어공학회 신진연구자상), Dec 2021
3rd Prize in Vision Meets Drones 2019: A Challenge (ICCV '19), Oct 2019
Title: Patch-level Augmentation for Object Detection in Aerial Images
3rd Prize in Unsupervised DAVIS Challenge on Video Object Segmentation (CVPR '19), Jun 2019
Title: Key Instance Selection for Unsupervised Video Object Segmentation
1st prize in SK telecom Tech Expert Board (TEB) excellent work awards, Oct 2018
Main tasks: 1) SK AI course lecturer 2) Naver tech talk 3) ranked 2nd in VizWiz Challenge
2nd Prize in VizWiz Grand Challenge: Answering Visual Questions from Blind People (ECCV '18), Sep 2018
Title: Bilinear Attention Networks for VizWiz Challenge
Naver Ph.D. Fellowship, Sep 2017
Ph.D. student who has published outstanding papers as the first author in an international top-tier conferences or journals
Outstanding Teaching Assistant Award, KAIST, Feb 2017
Role: Python programming instructor for undergraduates
LG Electronics Paper Award at IEEK Conference, IEEK, Jun 2016
Title: Deep CNN-based Person Identification using Facial and Clothing Features
Winner of Idea Contest for R&D Development Special Zone Support Division, Apr 2012
Title: Research complex childcare system
Award: Special Award
Winner of Future Idea Competition, KOLON-KAIST Life Style Innovation Center, Oct 2011
Title: Realistic sports broadcasting through sharing senses between athletes and viewers
Award: Grand Prize (10,000$)