Yan Ju （巨妍） Ph.D. Candidate Department of Computer Science and Engineering State University of New York at Buffalo Email: yanju AT buffalo DOT edu [Google Scholar][GitHub][Linkedin]

Biography

I am a Ph.D. Candidate in the Department of Computer Science and Engineering at State University of New York at Buffalo, advised by Prof. Siwei Lyu. Before that, I got B.Eng. and M.Eng. from Xidian University in 2016 and 2019.

My research interest lies in Trustworthy GenAI, focusing on detecting AI-generated image and video, protecting data copyright and fairness in generative models. If you're interested in collaborating, please don't hesitate to reach out!

News

• 05/20/24: I will be joining Samsung Research America AI Center (Mountain View, CA) as a Research Intern.
• 05/20/24: Our paper "DeepFake-O-Meter v2.0: An Open Platform for DeepFake Detection" was accepted in the MIPR 2024.
• 04/03/24: Our paper "Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics" was accepted in the CVPR Workshop on Media Forensics 2024.
• 02/26/24: Our paper "Preserving Fairness Generalization in Deepfake Detection" was accepted in the CVPR 2024.

Publications

• DeepFake-O-Meter v2.0: An Open Platform for DeepFake Detection. [Project Page]
  Yan Ju, Chengzhe Sun, Shan Jia, Shuwei Hou, Zhaofeng Si, Soumyya Kanti Datta, Lipeng Ke, Riky Zhou, Anita Nikolich, Siwei Lyu
  International Conference on Multimedia Information Processing and Retrieval, MIPR 2024
• Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics. [Paper]
  Shan Jia, Reilin Lyu, Kangran Zhao, Yize Chen, Zhiyuan Yan, Yan Ju, Chuanbo Hu, Xin Li, Baoyuan Wu, Siwei Lyu
  IEEE/CVF Computer Vision and Pattern Recognition Conference, CVPR Workshop on Media Forensics 2024
• Preserving Fairness Generalization in Deepfake Detection. [Paper] [Code]
  Li Lin, Xinan He, Yan Ju, Xin Wang, Feng Ding, Shu Hu
  IEEE/CVF Computer Vision and Pattern Recognition Conference, CVPR 2024
• Exposing Text-Image Inconsistency Using Diffusion Models. [Paper] [Project Page]
  Mingzhen Huang, Shan Jia, Zhou Zhou, Yan Ju, Jialing Cai, Siwei Lyu
  International Conference on Learning Representations, ICLR 2024
• Improving Fairness in Deepfake Detection. [Paper] [Code]
  Yan Ju, Shu Hu, Shan Jia, George H. Chen, Siwei Lyu
  IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2024
• GLFF: Global and Local Feature Fusion for AI-synthesized Image Detection. [Paper] [Code]
  Yan Ju, Shan Jia, Jialing Cai, Haiying Guan, Siwei Lyu
  IEEE Transactions on Multimedia, TMM
• Fusing Global and Local Features for Generalized AI-Synthesized Image Detection [Paper] [Code]
  Yan Ju, Shan Jia, Lipeng Ke, Hongfei Xue, Koki Nagano, Siwei Lyu
  The 29th IEEE International Conference on Image Processing, ICIP 2022
• AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensics. [Paper]
  Shan Jia, Mingzhen Huang, Zhou Zhou, Yan Ju, Jialing Cai, Siwei Lyu
  CVPR Workshop 2023
• M4esh: mmWave-based 3D Human Mesh Construction for Multiple Subjects. [Paper]
  Hongfei Xue, Qiming Cao, Yan Ju, Haochen Hu, Aidong Zhang, Lu Su
  Proceedings of the 20th ACM Conference on Embedded Networked Sensor System, SenSys 2022
• DeepFake-o-meter: An Open Platform for DeepFake Detection [Paper] [Demo]
  Yuezun Li, Cong Zhang, Pu Sun, Lipeng Ke, Yan Ju, Honggang Qi, and Siwei Lyu
  IEEE Security and Privacy Workshps, SPW 2021
• mmMesh: Towards 3D Real-Time Dynamic Human Mesh Construction Using Millimeter-wave [Paper] [Demo] [Presentation] [Project Page]
  Hongfei Xue, Yan Ju, Chenglin Miao, Yijiang Wang, Shiyang Wang, Aidong Zhang, Lu Su
  Proceedings of the 19th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2021
• Modified Diversity of Class Probability Estimation Co-training for Hyperspectral Image Classification [Paper] [Code]
  Yan Ju, Lingling Li, Licheng Jiao, Zhongle Ren, Biao Hou, Shuyuan Yang
  Preprints

Professional Services

I was served as reviewer for the following conferences and journals:

• Conferences: ECCV 2024; WACV 2025, 2024; MIPR 2024; CVPR Workshop 2023.
• Journals: IEEE Transactions on Information Forensics and Security (TIFS); IEEE Transactions on Multimedia (TMM); IEEE Transactions on Biometrics, Behavior, and Identity Science; Multimedia Systems; Journal of Selected Topics in Signal Processing.

Rewards

• Student Travel Grant, IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR), 2024.
• CSE Best Graduate Research Award, State University of New York at Buffalo, 2023.
• Student Travel Grant, IEEE/CVF Winter Conference on Applications of Computer Vision, 2024.