Fangneng Zhan 占方能

Fangneng Zhan 占方能

HKUST

Publications

* indicates equal contribution

2026

  • Yifan Liu, Fangneng Zhan, Kaichen Zhou, Yilun Du, Paul Pu Liang, Hanspeter Pfister. Abstract 3D Perception for Spatial Intelligence in Vision-Language Models. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026.
  • Yifan Liu, Fangneng Zhan, Haowen Sun, Katerina Fragkiadaki, Hanspeter Pfister. RoboTAG: End-to-end Robot Pose Estimation via Topological Alignment Graph. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026.
  • Tianling Xu, Shengzhe Gan, Leslie Gu, Yuelei Li, Fangneng Zhan, Hanspeter Pfister. AREA3D: Active Reconstruction Agent with Unified Feed-Forward 3D Perception and Vision-Language Guidance. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026.
  • Kaichen Zhou, Yuhan Wang, Grace Chen, Xinhai Chang, Gaspard Beaudouin, Fangneng Zhan, Paul Pu Liang, Mengyu Wang. PAGE-4D: Disentangled Pose and Geometry Estimation for 4D Perception. International Conference on Learning Representations (ICLR), 2026.
  • Muyu Xu, Fangneng Zhan, Xiaoqin Zhang, Ling Shao, Shijian Lu. MuSASplat: Efficient Sparse-View 3D Gaussian Splats via Lightweight Multi-Scale Adaptation. AAAI, 2026.
  • Jiahui Zhang, Yuelei Li, Anpei Chen, Muyu Xu, Kunhao Liu, Jianyuan Wang, Xiaoxiao Long, Hanxue Liang, Zexiang Xu, Hao Su, Christian Theobalt, Christian Rupprecht, Andrea Vedaldi, Kaichen Zhou, Hanspeter Pfister, Paul Pu Liang, Shijian Lu, Fangneng Zhan. Advances in Feed-Forward 3D Reconstruction and View Synthesis. Computer Graphics Forum (CGF), 2026.

2025

  • Pramod Rao, Xilong Zhou, Abhimitra Meka, Gereon Fox, Mallikarjun B R, Fangneng Zhan, Tim Weyrich, Bernd Bickel, Hanspeter Pfister, Wojciech Matusik, Thabo Beeler, Mohamed Elgharib, Marc Habermann, Christian Theobalt. 3DPR: Single Image 3D Portrait Relighting with Generative Priors. SIGGRAPH ASIA, 2025.
  • Jiahui Zhang, Fangneng Zhan, Ling Shao, Shijian Lu. SOGS: Second-Order Anchor for Advanced 3D Gaussian Splatting. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
  • Qian Wang, Abdelrahman Eldesokey, Mohit Mendiratta, Fangneng Zhan, Adam Kortylewski, Christian Theobalt, Peter Wonka. Zero-Shot Video Semantic Segmentation based on Pre-Trained Diffusion Models. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025.
  • Yuelei Li, Hyunjin Kim, Fangneng Zhan, Ri-Zhao Qiu, Mazeyu Ji, Xiaojun Shan, Paul Pu Liang, Hanspeter Pfister, Xiaolong Wang. Visual Acoustic Fields. ArXiv preprint, 2025.

2024

  • Fangneng Zhan*, Hanxue Liang*, Michael Niemeyer, Yifan Wang, Michael Oechsle, Adam Kortylewski, Cengiz Oztireli, Gordon Wetzstein, Christian Theobalt. Evolutive Rendering Models. Preprint, 2024.
  • Yu Chi, Fangneng Zhan, Sibo Wu, Christian Theobalt, Adam Kortylewski. DatasetNeRF: Efficient 3D-aware Data Factory with Generative Radiance Fields. European Conference on Computer Vision (ECCV), 2024.
  • Pramod Ramesh Rao, Mallikarjun B R, Abhimitra Meka, Gereon Fox, Fangneng Zhan, Tim Weyrich, Bernd Bickel, Hanspeter Pfister, Wojciech Matusik, Mohamed Elgharib, Christian Theobalt. Lite2Relight: 3D-aware Single Image Portrait Relighting. SIGGRAPH, 2024.
  • Heming Zhu, Fangneng Zhan, Christian Theobalt, Marc Habermann. TriHuman: A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesis. ACM Transactions on Graphics (TOG), 2024.
  • Kunhao Liu, Fangneng Zhan, Muyu Xu, Christian Theobalt, Ling Shao, Shijian Lu. StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting. SIGGRAPH Asia, 2024 (Technical Communications).
  • Jiahui Zhang, Fangneng Zhan, Muyu Xu, Shijian Lu, Eric P. Xing. FreGS: 3D Gaussian Splatting with Progressive Frequency Regularization. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  • Zuhao Yang, Fangneng Zhan, Kunhao Liu, Jiahui Zhang, Muyu Xu, Christian Theobalt, Eric Xing, Shijian Lu. AI-Generated Images as Data Source: The Dawn of Synthetic Era. ArXiv preprint, 2024.

2023

  • Kunhao Liu, Fangneng Zhan, Jiahui Zhang, Muyu Xu, Yingchen Yu, Abdulmotaleb El Saddik, Christian Theobalt, Eric Xing, Shijian Lu. 3D Open-vocabulary Segmentation with Foundation Models. Conference on Neural Information Processing Systems (NeurIPS), 2023.
  • Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Shijian Lu, Lingjie Liu, Adam Kortylewski, Christian Theobalt, Eric Xing. Multimodal Visual Synthesis and Editing: The Generative AI Era. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023. (Top 50 Most Popular TPAMI Paper)
  • Muyu Xu, Fangneng Zhan, Jiahui Zhang, Rongliang Wu, Yingchen Yu, Christian Theobalt, Shijian Lu. WaveNeRF: Wavelet-based Generalizable Neural Radiance Fields. IEEE International Conference on Computer Vision (ICCV), 2023.
  • Jiahui Zhang, Fangneng Zhan, Rongliang Wu, Yingchen Yu, Kunhao Liu, Christian Theobalt, Shijian Lu. Pose-Free Neural Radiance Fields via Implicit Pose Regularization. IEEE International Conference on Computer Vision (ICCV), 2023.
  • Pramod Rao, Mallikarjun B R, Gereon Fox, Tim Weyrich, Bernd Bickel, Hanspeter Pfister, Wojciech Matusik, Fangneng Zhan, Ayush Tewari, Christian Theobalt, Mohamed Elgharib. A Deeper Analysis of Volumetric Relightable Fields. International Journal of Computer Vision (IJCV), 2023. (Invited Paper, BMVC Best Paper Award Honourable Mention)
  • Fangneng Zhan, Lingjie Liu, Adam Kortylewski, Christian Theobalt. General Neural Gauge Fields. International Conference on Learning Representations (ICLR), 2023.
  • Rongliang Wu, Yingchen Yu, Fangneng Zhan, Jiahui Zhang, Shijian Lu. POCE: Pose-Controllable Expression Editing with Unpaired Training Images. IEEE Transactions on Image Processing (TIP), 2023.
  • Kunhao Liu, Fangneng Zhan, Yiwen Chen, Jiahui Zhang, Yingchen Yu, Shijian Lu. StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  • Kaiwen Cui, Yingchen Yu, Fangneng Zhan, Shengcai Liao, Shijian Lu, Eric Xing. KD-GAN: Data Limited Image Generation via Knowledge Distillation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  • Jiahui Zhang, Fangneng Zhan, Christian Theobalt, Shijian Lu. Regularized Vector Quantization for Tokenized Image Synthesis. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  • Kaiwen Cui, Rongliang Wu, Fangneng Zhan, Shijian Lu. Face Transformer: Towards High Fidelity and Accurate Face Swapping. IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2023.
  • Rongliang Wu, Yingchen Yu, Fangneng Zhan, Jiahui Zhang, Shijian Lu, Eric Xing. Audio-Driven Talking Face Generation with Diverse yet Realistic Facial Animations. Pattern Recognition (PR), 2023.

2022

  • Jiaxing Huang, Kaiwen Cui, Dayan Guan, Aoran Xiao, Fangneng Zhan, Shijian Lu, Shengcai Liao, Eric Xing. Masked Generative Adversarial Networks are Robust Generation Learners. Conference on Neural Information Processing Systems (NeurIPS), 2022. (Spotlight)
  • Yingchen Yu*, Fangneng Zhan*, Rongliang Wu, Jiahui Zhang, Kaiwen Cui, Aoran Xiao, Shijian Lu, Chunyan Miao. Bi-level Feature Alignment for Versatile Image Translation and Manipulation. European Conference on Computer Vision (ECCV), 2022.
  • Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Kaiwen Cui, Changgong Zhang, Shijian Lu. Auto-regressive Image Modeling with Integrated Quantization. European Conference on Computer Vision (ECCV), 2022. (Oral Presentation)
  • Jiahui Zhang, Fangneng Zhan, Rongliang Wu, Yingchen Yu, Wenqing Zhang, Song Bai, Xiaoqin Zhang, Shijian Lu. VMRF: View Matching Neural Radiance Fields. ACM International Conference on Multimedia (ACM MM), 2022.
  • Yingchen Yu, Fangneng Zhan, Rongliang Wu, Jiahui Zhang, Shijian Lu, Miaomiao Cui, Xuansong Xie, Xian-Sheng Hua, Chunyan Miao. Towards Counterfactual Image Manipulation via CLIP. ACM International Conference on Multimedia (ACM MM), 2022.
  • Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Shijian Lu, Changgong Zhang. Marginal Correspondence for Conditional Image Generation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. (Oral Presentation)
  • Chuhui Xue, Zichen Tian, Fangneng Zhan, Shijian Lu, Song Bai. Fourier Document Restoration for Robust Document Dewarping and Recognition. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  • Fangneng Zhan, Yingchen Yu, Kaiwen Cui, Gongjie Zhang, Shijian Lu, Jianxiong Pan, Changgong Zhang, Feiying Ma, Xuansong Xie, Chunyan Miao. Modulated Contrast for Versatile Image Synthesis. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
  • Changgong Zhang, Fangneng Zhan, Yingchen Yu, Rongliang Wu, Wenbo Hu, Shijian Lu, Feiying Ma, Xuansong Xie, Ling Shao. GMLight: Lighting Estimation via Geometric Distribution Approximation. IEEE Transactions on Image Processing (TIP), 2022.
  • Kaiwen Cui, Jiaxing Huang, Zhipeng Luo, Gongjie Zhang, Fangneng Zhan, Shijian Lu. GenCo: Generative Cotraining on Data Limited Image Generation. AAAI Conference on Artificial Intelligence (AAAI), 2022.
  • Aoran Xiao, Jiaxing Huang, Dayan Guan, Fangneng Zhan, Shijian Lu. Transfer Learning from Synthetic to Real LiDAR Point Cloud for Semantic Segmentation. AAAI Conference on Artificial Intelligence (AAAI), 2022.

2021

  • Fangneng Zhan, Yingchen Yu, Kaiwen Cui, Gongjie Zhang, Shijian Lu, Jianxiong Pan, Changgong Zhang, Feiying Ma, Xuansong Xie, Chunyan Miao. Unbalanced Feature Transport for Exemplar-based Image Translation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  • Yingchen Yu, Fangneng Zhan, Shijian Lu, Jianxiong Pan, Feiying Ma, Xuansong Xie, Chunyan Miao. WaveFill: A Wavelet-based Generation Network for Image Inpainting. IEEE International Conference on Computer Vision (ICCV), 2021. (Oral Presentation)
  • Fangneng Zhan*, Changgong Zhang*, Wenbo Hu, Shijian Lu, Feiying Ma, Xuansong Xie, Ling Shao. Sparse Needlets for Lighting Estimation with Spherical Transport Loss. IEEE International Conference on Computer Vision (ICCV), 2021.
  • Fangneng Zhan*, Changgong Zhang*, Yingchen Yu, Yuan Chang, Shijian Lu, Feiying Ma, Xuansong Xie. EMLight: Lighting Estimation via Spherical Distribution Approximation. AAAI Conference on Artificial Intelligence (AAAI), 2021.
  • Yingchen Yu*, Fangneng Zhan*, Rongliang Wu, Jianxiong Pan, Kaiwen Cui, Shijian Lu, Feiying Ma, Xuansong Xie, Chunyan Miao. Diverse Image Inpainting with Bidirectional and Autoregressive Transformers. ACM International Conference on Multimedia (ACM MM), 2021. (Oral Presentation)
  • Wenbo Hu, Changgong Zhang, Fangneng Zhan, Lei Zhang, Tien-Tsin Wong. Conditional Directed Graph Convolution for 3D Human Pose Estimation. ACM International Conference on Multimedia (ACM MM), 2021.

2020

  • Changgong Zhang, Fangneng Zhan, Shijian Lu, Feiying Ma, Xuansong Xie. Adversarial Image Composition with Auxiliary Illumination. Asia Conference on Computer Vision (ACCV), 2020. (Oral Presentation)

2019

  • Fangneng Zhan, Chuhui Xue, Shijian Lu. GA-DAN: Geometry-Aware Domain Adaptation with Generative Adversarial Networks. IEEE International Conference on Computer Vision (ICCV), 2019.
  • Changgong Zhang, Fangneng Zhan. Spatial-Aware GAN for Unsupervised Person Re-identification. International Conference on Pattern Recognition (ICPR), 2019.
  • Fangneng Zhan, Hongyuan Zhu, Shijian Lu. Spatial Fusion GAN for Image Synthesis. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  • Fangneng Zhan, Shijian Lu. ESIR: End-to-end Scene Recognition via Iterative Image Transformation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.

2018

  • Chuhui Xue, Shijian Lu, Fangneng Zhan. Accurate Scene Text Detection Through Border Semantics Awareness and Bootstrapping. European Conference on Computer Vision (ECCV), 2018.
  • Fangneng Zhan, Chuhui Xue, Shijian Lu. Verisimilar Image Synthesis for Accurate Detection and Recognition. European Conference on Computer Vision (ECCV), 2018.