Abstract: In recent years, there have been astonishing advances in AI-based synthetic media generation. Thanks to deep learning-based approaches, it is now possible to generate data with a high level of realism. While this opens up new opportunities for the entertainment industry, it simultaneously undermines the reliability of multimedia content and supports the spread of false or manipulated information on the Internet. This is especially true for human faces, allowing to easily create new identities or change only some specific attributes of a real face in a video, so-called deepfakes. In this context, it is important to develop automated tools to detect manipulated media in a reliable and timely manner. This talk will describe the most reliable deep learning-based approaches for detecting deepfakes, with a focus on those that enable domain generalization. The results will be presented on challenging datasets with reference to realistic scenarios, such as the dissemination of manipulated images and videos on social networks. Finally, new possible directions will be outlined.

Speaker’s Bio: Dr. Luisa Verdoliva is an Associate Professor at the University Federico II of Naples, Italy, where she leads the Multimedia Forensics Lab. In 2018 she was visiting professor at Friedrich-Alexander-University, and in 2019-2020 she was visiting scientist at Google AI in San Francisco. Her main contributions are in the area of multimedia forensics. She has published over 120 academic publications, including 45 journal papers. She has been technical Chair of the 2019 IEEE Workshop in Information Forensics and Security, general co-Chair of the 2019 ACM Workshop on Information Hiding and Multimedia Security, and technical Chair of this same Workshop in 2021. She is on the Editorial Board of IEEE Transactions on Information Forensics and Security and IEEE Signal Processing Letters. Dr. Verdoliva is Chair of the IEEE Information Forensics and Security Technical Committee. She is the recipient of the 2018 Google Faculty Award and a TUM-IAS Hans Fischer Senior Fellowship. She is IEEE Fellow.

Abstract: Despite significant advancements in deep learning-based forgery detectors for distinguishing manipulated deepfake images, most detection approaches suffer from moderate to significant performance degradation with low-quality compressed deepfake images. Also, it is challenging to detect different types of deepfake images simultaneously. In this work, we apply frequency domain learning and optimal transport theory in knowledge distillation (KD) to specifically improve the detection of low-quality compressed deepfake images. We explore transfer learning capability in KD to enable a student network to learn discriminative features from low-quality images effectively. In addition, we also discuss the continual learning and domain adaptation methods to detect various types of deepfakes simultaneously.

Speaker’s Bio: Simon S. Woo received his M.S. and Ph.D. in Computer Science from Univ. of Southern California (USC), Los Angeles, M.S. in Electrical and Computer Engineering from the University of California, San Diego (UCSD), and B.S. in Electrical Engineering from the University of Washington (UW), Seattle. He was a member of technical staff (technologist) for 9 years at the NASA's Jet Propulsion Lab (JPL), Pasadena, CA, conducting research in satellite communications, networking and cybersecurity areas. Also, he worked at Intel Corp. and Verisign Research Lab. Since 2017, he has been a tenure-track Assistant Professor at SUNY, South Korea, and a Research Assistant Professor at Stony Brook University. Now, he is a tenure-track Assistant Professor at the Department of Artificial Intelligence, Applied Data Science, and Software at Sungkyunkwan University, Suwon, Korea. His current research focuses on deepfakes, multimedia security and privacy, and other data science and AI applications, including vision and anomaly detection.