Selected Publications

The following list contains selected publications that are relevant to the group's research focus on generative and robust AI.
A complete list of publications can be obtained from Google Scholar.

2024

Discovering Failure Modes of Text-guided Diffusion Models via Adversarial Search
Qihao Liu, Adam Kortylewski, Yutong Bai, Song Bai, Alan Yuille
International Conference on Learning Representations (ICLR) 2024
arXiv PDF
Source-Free and Image-Only Unsupervised Domain Adaptation for Category Level Object Pose Estimation
Prakhar Kaushik, Aayush Mishra, Adam Kortylewski, Alan Yuille
International Conference on Learning Representations (ICLR) 2024
arXiv PDF
Adding 3D Geometry Control to Diffusion Models
Wufei Ma, Qihao Liu, Jiahao Wang, Xiaoding Yuan, Angtian Wang, Yi Zhang, Zihao Xiao, Guofeng Zhang, Beijia Lu, Ruxiao Duan, Yongrui Qi, Adam Kortylewski, Yaoyao Liu, Alan Yuille
International Conference on Learning Representations (ICLR) 2024
Selected as spotlight (top 5%)
arXiv PDF
Neural Textured Deformable Meshes for Robust Analysis-by-Synthesis
Angtian Wang, Wufei Ma, Alan Yuille, Adam Kortylewski
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024
arXiv PDF
Robust Category-Level 3D Pose Estimation from Synthetic Data
Jiahao Yang, Wufei Ma, Angtian Wang, Xiaoding Yuan, Alan Yuille, Adam Kortylewski
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024
arXiv PDF

2023

3D-Aware Visual Question Answering about Parts, Poses and Occlusions
Xingrui Wang, Wufei Ma, Zhuowan Li, Adam Kortylewski, Alan Yuille
Advances in Neural Information Processing Systems (NeurIPS) 2023
arXiv PDF Code coming soon.
Multimodal Image Synthesis and Editing: The Generative AI Era
Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Shijian Lu, Lingjie Liu, Adam Kortylewski, Christian Theobalt, Eric Xing
IEEE transactions on pattern analysis and machine intelligence (TPAMI)
arXiv PDF Code
Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shape
Jiacong Xu, Yi Zhang, Jiawei Peng, Wufei Ma, Artur Jesslen, Pengliang Ji, Qixin Hu, Jiehua Zhang, Qihao Liu, Jiahao Wang, Wei Ji, Chen Wang, Xiaoding Yuan, Prakhar Kaushik, Guofeng Zhang, Jie Liu, Yushan Xie, Yawen Cui, Alan Yuille, Adam Kortylewski
Proceedings of the International Conference on Computer Vision (ICCV) 2023
arXiv PDF Dataset
3D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimation
Yi Zhang, Pengliang Ji, Angtian Wang, Adam Kortylewski, Alan Yuille
Proceedings of the International Conference on Computer Vision (ICCV) 2023
arXiv PDF Code
Robust Model-based Face Reconstruction through Weakly-Supervised Outlier Segmentation
Chunlu Li, Andreas Morel-Forster, Thomas Vetter, Bernhard Egger, Adam Kortylewski
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023
arXiv PDF Code
Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning
Zhuowan Li, Xingrui Wang, Wufei Ma, Elias Stengel-Eskin, Adam Kortylewski, Benjamin Van Durme, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023
Selected as highlight (top 2.5%)
arXiv PDF Code and Data
PoseExaminer: Automated Testing of Out-of-Distribution Robustness in Human Pose and Shape Estimation
Qihao Liu, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023
arXiv PDF Code
General Neural Gauge Fields
Fangneng Zhan, Lingjie Liu, Adam Kortylewski, Christian Theobalt
International Conference on Learning Representations (ICLR), 2023
PDF
VoGE: A Differentiable Volume Renderer using Gaussian Ellipsoids for Analysis-by-Synthesis
Angtian Wang, Peng Wang, Jian Sun, Adam Kortylewski, Alan Yuille
International Conference on Learning Representations (ICLR), 2023
arXiv PDF
Coke: Localized Contrastive Learning for Robust Keypoint Detection
Yutong Bai, Angtian Wang, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023
arXiv PDF

2022


HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flow
Jiayi Wang, Diogo Luvizon, Franziska Mueller, Florian Bernard, Adam Kortylewski, Dan Casas, Christian Theobalt
International Symposium on Vision, Modeling, and Visualization (VMV) 2022
Best Paper Honorable Mention
PDF
OOD-CV: A Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images
Bingchen Zhao, Shaozuo Yu, Wufei Ma, Mingxin Yu, Shenxiao Mei, Angtian Wang, Ju He, Alan Yuille, Adam Kortylewski
Proceedings of the European Conference on Computer Vision (ECCV) 2022
Selected as Oral (top 3%)
arXiv PDF Challenge Dataset
Robust Category-Level 6D Pose Estimation with Coarse-to-Fine Rendering of Neural Features
Wufei Ma, Angtian Wang, Alan Yuille, Adam Kortylewski
Proceedings of the European Conference on Computer Vision (ECCV) 2022
arXiv PDF
PartImageNet: A Large, High-Quality Dataset of Parts
Ju He, Shuo Yang, Shaokang Yang, Adam Kortylewski, Xiaoding Yuan, Jie-Neng Chen, Shuai Liu, Cheng Yang, Alan Yuille
Proceedings of the European Conference on Computer Vision (ECCV) 2022
arXiv PDF Dataset
Amodal Segmentation through Out-of-Task and Out-of-Distribution Generalization with a Bayesian Model
Yihong Sun, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
arXiv PDF Code
Learning Part Segmentation through Unsupervised Domain Adaptation from Synthetic Vehicles
Qing Liu, Adam Kortylewski, Zhishuai Zhang, Zizhang Li, Mengqi Guo, Qihao Liu, Xiaoding Yuan, Jiteng Mu, Weichao Qiu, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
Selected as Oral
arXiv PDF Dataset & Code
Simulated Adversarial Testing of Face Recognition Models
Nataniel Ruiz, Adam Kortylewski, Weichao Qiu, Cihang Xie, Sarah Adel Bargal, Alan Yuille, Stan Sclaroff
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
arXiv PDF
SwapMix: Diagnosing and Regularizing the Over-reliance on Visual Context in Visual Question Answering
Vipul Gupta, Zhuowan Li, Adam Kortylewski, Chenyu Zhang, Yingwei Li, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
arXiv PDF
TransFG: A Transformer Architecture for Fine-grained Recognition
Ju He, Jie-Neng Chen, Shuai Liu, Adam Kortylewski, Cheng Yang, Yutong Bai, Changhu Wang, Alan Yuille
Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) 2022
arXiv PDF Code

2021


Neural View Synthesis and Matching for Semi-Supervised Few-Shot Learning of 3D Pose
Angtian Wang, Shenxiao Mei, Alan Yuille, Adam Kortylewski
Advances in Neural Information Processing Systems (NeurIPS) 2021
arXiv PDF Code
A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representation
Jiteng Mu, Weichao Qiu, Adam Kortylewski, Alan Yuille, Nuno Vasconcelos, Xiaolong Wang
Proceedings of the IEEE International Conference on Computer Vision (ICCV) 2021
arXiv PDF Code Video
Robust Instance Segmentation through Reasoning about Multi-Object Occlusion
Xiaoding Yuan, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021
arXiv PDF Code
NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimation
Angtian Wang, Adam Kortylewski, Alan Yuille
International Conference on Learning Representations (ICLR) 2021
arXiv PDF Code Video
Compositional Generative Networks and Robustness to Perceptible Image Changes
Adam Kortylewski, Ju He, Qing Liu, Christian Cosgrove, Chenglin Yang, Alan Yuille
55th Annual Conference on Information Sciences and Systems (CISS) 2021
IEEEexplore PDF
Compositional Convolutional Neural Networks: A Robust and Interpretable Model for Object Recognition under Occlusion
Adam Kortylewski, Qing Liu, Angtian Wang, Yihong Sun, Alan Yuille
International Journal of Computer Vision (IJCV) 2021
PDF Code

2020


PatchAttack: A Black-box Texture-based Attack with Reinforcement Learning
Chenglin Yang, Adam Kortylewski, Cihang Xie, Yinzhi Cao, Alan Yuille
Proceedings of the European Conference on Computer Vision (ECCV) 2020
arXiv PDF Code
Robust Object Detection under Occlusion with Context-Aware CompositionalNets
Angtian Wang, Yihong Sun, Adam Kortylewski(*), Alan Yuille(*)
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020
arXiv PDF
Compositional Convolutional Neural Networks: A Deep Architecture with Innate Robustness to Partial Occlusion
Adam Kortylewski, Ju He, Qing Liu, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020
arXiv PDF Supplementary Code Video
compnet
3D Morphable Face Models - Past, Present and Future
Bernhard Egger, William A.P Smith, Ayush Tewari, Stefanie Wuhrer, Michael Zollhoefer, Thabo Beeler, Florian Bernhard, Timo Bolkart, Adam Kortylewski, Sami Romdhani, Christian Theobalt, Volker Blanz, Thomas Vetter.
ACM Transactions on Graphics (TOG)
arXiv PDF Video
tdapnet
TDAPNet: Prototype Network with Recurrent Top-Down Attention for Robust Object Classification under Partial Occlusion
Mingqing Xiao, Adam Kortylewski, Ruihai Wu, Siyuan Qiao, Wei Shen, Alan Yuille.
ECCV 2020 Workshop on Visual Inductive Priors for Data-Efficient Deep Learning
PDF
compnet
Combining Compositional Models and Deep Networks For Robust Object Classification under Occlusion
Adam Kortylewski, Qing Liu, Huiyu Wang, Zhishuai Zhang, Alan Yuille.
IEEE Winter Conference on Applications of Computer Vision (WACV) 2020.
Spotlight
arXiv PDF Video

2019


Localizing Occluders with Compositional Convolutional Networks
Adam Kortylewski, Qing Liu, Huiyu Wang, Zhishuai Zhang, Alan Yuille
Advances in Neural Information Processing Systems 2019, Context and Compositionality in Biological and Artificial Neural Systems Workshop.
IEEE International Conference on Computer Vision (ICCV) 2019, Neural Architects Workshop
PDF
greedy
Greedy Structure Learning of Hierarchical Compositional Models
Adam Kortylewski, Clemens Blumer, Aleksander Wieczorek, Mario Wieser, Sonali Parbhoo, Andreas Morel-Forster, Volker Roth, Thomas Vetter.
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019
PDF