Selected Publications

The following list contains selected publications that are relevant to the group's research focus.
A complete list of publications can be obtained from Google Scholar.

2024


Unsupervised Learning of Category-Level 3D Pose from Object-Centric Videos
Leonhard Sommer, Artur Jesslen, Eddy Ilg, Adam Kortylewski
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024
A Bayesian Approach to OOD Robustness in Image Classification
Prakhar Kaushik, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024
DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data
Qihao Liu, Yi Zhang, Song Bai, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024
ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering
Haokai Pang, Heming Zhu, Adam Kortylewski, Christian Theobalt, Marc Habermann
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024
Discovering Failure Modes of Text-guided Diffusion Models via Adversarial Search
Qihao Liu, Adam Kortylewski, Yutong Bai, Song Bai, Alan Yuille
International Conference on Learning Representations (ICLR) 2024
Source-Free and Image-Only Unsupervised Domain Adaptation for Category Level Object Pose Estimation
Prakhar Kaushik, Aayush Mishra, Adam Kortylewski, Alan Yuille
International Conference on Learning Representations (ICLR) 2024
Adding 3D Geometry Control to Diffusion Models
Wufei Ma, Qihao Liu, Jiahao Wang, Xiaoding Yuan, Angtian Wang, Yi Zhang, Zihao Xiao, Guofeng Zhang, Beijia Lu, Ruxiao Duan, Yongrui Qi, Adam Kortylewski, Yaoyao Liu, Alan Yuille
International Conference on Learning Representations (ICLR) 2024
Selected as spotlight (top 5%)
Neural Textured Deformable Meshes for Robust Analysis-by-Synthesis
Angtian Wang, Wufei Ma, Alan Yuille, Adam Kortylewski
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024
Robust Category-Level 3D Pose Estimation from Synthetic Data
Jiahao Yang, Wufei Ma, Angtian Wang, Xiaoding Yuan, Alan Yuille, Adam Kortylewski
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024

2023


3D-Aware Visual Question Answering about Parts, Poses and Occlusions
Xingrui Wang, Wufei Ma, Zhuowan Li, Adam Kortylewski, Alan Yuille
Advances in Neural Information Processing Systems (NeurIPS) 2023
Multimodal Image Synthesis and Editing: The Generative AI Era
Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Shijian Lu, Lingjie Liu, Adam Kortylewski, Christian Theobalt, Eric Xing
IEEE transactions on pattern analysis and machine intelligence (TPAMI)
Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shape
Jiacong Xu, Yi Zhang, Jiawei Peng, Wufei Ma, Artur Jesslen, Pengliang Ji, Qixin Hu, Jiehua Zhang, Qihao Liu, Jiahao Wang, Wei Ji, Chen Wang, Xiaoding Yuan, Prakhar Kaushik, Guofeng Zhang, Jie Liu, Yushan Xie, Yawen Cui, Alan Yuille, Adam Kortylewski
Proceedings of the International Conference on Computer Vision (ICCV) 2023
3D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimation
Yi Zhang, Pengliang Ji, Angtian Wang, Adam Kortylewski, Alan Yuille
Proceedings of the International Conference on Computer Vision (ICCV) 2023
Robust Model-based Face Reconstruction through Weakly-Supervised Outlier Segmentation
Chunlu Li, Andreas Morel-Forster, Thomas Vetter, Bernhard Egger, Adam Kortylewski
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023
Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning
Zhuowan Li, Xingrui Wang, Wufei Ma, Elias Stengel-Eskin, Adam Kortylewski, Benjamin Van Durme, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023
Selected as highlight (top 2.5%)
PoseExaminer: Automated Testing of Out-of-Distribution Robustness in Human Pose and Shape Estimation
Qihao Liu, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023
General Neural Gauge Fields
Fangneng Zhan, Lingjie Liu, Adam Kortylewski, Christian Theobalt
International Conference on Learning Representations (ICLR), 2023
PDF
VoGE: A Differentiable Volume Renderer using Gaussian Ellipsoids for Analysis-by-Synthesis
Angtian Wang, Peng Wang, Jian Sun, Adam Kortylewski, Alan Yuille
International Conference on Learning Representations (ICLR), 2023
Coke: Localized Contrastive Learning for Robust Keypoint Detection
Yutong Bai, Angtian Wang, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023

2022



HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flow
Jiayi Wang, Diogo Luvizon, Franziska Mueller, Florian Bernard, Adam Kortylewski, Dan Casas, Christian Theobalt
International Symposium on Vision, Modeling, and Visualization (VMV) 2022
Best Paper Honorable Mention
PDF
OOD-CV: A Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images
Bingchen Zhao, Shaozuo Yu, Wufei Ma, Mingxin Yu, Shenxiao Mei, Angtian Wang, Ju He, Alan Yuille, Adam Kortylewski
Proceedings of the European Conference on Computer Vision (ECCV) 2022
Selected as Oral (top 3%)
Robust Category-Level 6D Pose Estimation with Coarse-to-Fine Rendering of Neural Features
Wufei Ma, Angtian Wang, Alan Yuille, Adam Kortylewski
Proceedings of the European Conference on Computer Vision (ECCV) 2022
PartImageNet: A Large, High-Quality Dataset of Parts
Ju He, Shuo Yang, Shaokang Yang, Adam Kortylewski, Xiaoding Yuan, Jie-Neng Chen, Shuai Liu, Cheng Yang, Alan Yuille
Proceedings of the European Conference on Computer Vision (ECCV) 2022
Amodal Segmentation through Out-of-Task and Out-of-Distribution Generalization with a Bayesian Model
Yihong Sun, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
Learning Part Segmentation through Unsupervised Domain Adaptation from Synthetic Vehicles
Qing Liu, Adam Kortylewski, Zhishuai Zhang, Zizhang Li, Mengqi Guo, Qihao Liu, Xiaoding Yuan, Jiteng Mu, Weichao Qiu, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
Selected as Oral
Simulated Adversarial Testing of Face Recognition Models
Nataniel Ruiz, Adam Kortylewski, Weichao Qiu, Cihang Xie, Sarah Adel Bargal, Alan Yuille, Stan Sclaroff
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
SwapMix: Diagnosing and Regularizing the Over-reliance on Visual Context in Visual Question Answering
Vipul Gupta, Zhuowan Li, Adam Kortylewski, Chenyu Zhang, Yingwei Li, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
TransFG: A Transformer Architecture for Fine-grained Recognition
Ju He, Jie-Neng Chen, Shuai Liu, Adam Kortylewski, Cheng Yang, Yutong Bai, Changhu Wang, Alan Yuille
Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) 2022

2021



Neural View Synthesis and Matching for Semi-Supervised Few-Shot Learning of 3D Pose
Angtian Wang, Shenxiao Mei, Alan Yuille, Adam Kortylewski
Advances in Neural Information Processing Systems (NeurIPS) 2021
A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representation
Jiteng Mu, Weichao Qiu, Adam Kortylewski, Alan Yuille, Nuno Vasconcelos, Xiaolong Wang
Proceedings of the IEEE International Conference on Computer Vision (ICCV) 2021
Robust Instance Segmentation through Reasoning about Multi-Object Occlusion
Xiaoding Yuan, Adam Kortylewski, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021
NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimation
Angtian Wang, Adam Kortylewski, Alan Yuille
International Conference on Learning Representations (ICLR) 2021
Compositional Generative Networks and Robustness to Perceptible Image Changes
Adam Kortylewski, Ju He, Qing Liu, Christian Cosgrove, Chenglin Yang, Alan Yuille
55th Annual Conference on Information Sciences and Systems (CISS) 2021
Compositional Convolutional Neural Networks: A Robust and Interpretable Model for Object Recognition under Occlusion
Adam Kortylewski, Qing Liu, Angtian Wang, Yihong Sun, Alan Yuille
International Journal of Computer Vision (IJCV) 2021

2020



PatchAttack: A Black-box Texture-based Attack with Reinforcement Learning
Chenglin Yang, Adam Kortylewski, Cihang Xie, Yinzhi Cao, Alan Yuille
Proceedings of the European Conference on Computer Vision (ECCV) 2020
Robust Object Detection under Occlusion with Context-Aware CompositionalNets
Angtian Wang, Yihong Sun, Adam Kortylewski(*), Alan Yuille(*)
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020
Compositional Convolutional Neural Networks: A Deep Architecture with Innate Robustness to Partial Occlusion
Adam Kortylewski, Ju He, Qing Liu, Alan Yuille
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020
compnet
3D Morphable Face Models - Past, Present and Future
Bernhard Egger, William A.P Smith, Ayush Tewari, Stefanie Wuhrer, Michael Zollhoefer, Thabo Beeler, Florian Bernhard, Timo Bolkart, Adam Kortylewski, Sami Romdhani, Christian Theobalt, Volker Blanz, Thomas Vetter.
ACM Transactions on Graphics (TOG)
tdapnet
TDAPNet: Prototype Network with Recurrent Top-Down Attention for Robust Object Classification under Partial Occlusion
Mingqing Xiao, Adam Kortylewski, Ruihai Wu, Siyuan Qiao, Wei Shen, Alan Yuille.
ECCV 2020 Workshop on Visual Inductive Priors for Data-Efficient Deep Learning
PDF
compnet
Combining Compositional Models and Deep Networks For Robust Object Classification under Occlusion
Adam Kortylewski, Qing Liu, Huiyu Wang, Zhishuai Zhang, Alan Yuille.
IEEE Winter Conference on Applications of Computer Vision (WACV) 2020.
Spotlight

2019



Localizing Occluders with Compositional Convolutional Networks
Adam Kortylewski, Qing Liu, Huiyu Wang, Zhishuai Zhang, Alan Yuille
Advances in Neural Information Processing Systems 2019, Context and Compositionality in Biological and Artificial Neural Systems Workshop.
IEEE International Conference on Computer Vision (ICCV) 2019, Neural Architects Workshop
PDF
greedy
Greedy Structure Learning of Hierarchical Compositional Models
Adam Kortylewski, Clemens Blumer, Aleksander Wieczorek, Mario Wieser, Sonali Parbhoo, Andreas Morel-Forster, Volker Roth, Thomas Vetter.
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019
PDF