News:

     [2024-03-28] Our paper "QT-Font: High-efficiency Font Synthesis via Quadtree-based Diffusion Models" has been accepted by SIGGRAPH 2024 (source code and data will be available)

     [2024-03-28] Our paper "CalliRewrite: Recovering Handwriting Behaviors from Calligraphy Images without Supervision" has been accepted by ICRA 2024 (source code and data are available)

     [2024-02-27] Our papers "En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Data", "3DToonify: Creating Your High-Fidelity 3D Stylized Avatar Easily from 2D Portrait Images" and "TextNeRF: A Novel Scene-Text Image Synthesis Method based on Neural Radiance Fields" have been accepted by CVPR 2024 (source code and data will be available)

     [2023-12-25] Our paper "DeepCalliFont: Few-shot Chinese Calligraphy Font Synthesis by Integrating Dual-modality Generative Models" has been accepted by AAAI 2024 (source code)

     [2022-09-05] Our paper "SinMPI: Novel View Synthesis from a Single Image with Expanded Multiplane Images" has been accepted by SIGGRAPH Asia 2023 (source code and data are available)

     [2023-03-08] I will serve as an Area Chair for NeurIPS 2023.

     [2023-03-01] Our papers "DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Quality" and "VecFontSDF: Learning to Reconstruct and Synthesize High-quality Vector Fonts via Signed Distance Functions" have been accepted by CVPR 2023 (source code and data are available)

     [2022-09-14] I will serve as an Area Chair for CVPR 2023.

     [2022-09-05] Our paper "DifferSketching: How Differently Do People Sketch 3D Objects?" has been accepted in ACM Transactions on Graphics (to be presented at SIGGRAPH Asia 2022)

     [2022-07-07] Our paper "Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning" has been accepted by ACM MM 2022 (source code and data)

     [2022-04-26] Our paper "DCT-Net: Domain-calibrated Translation for Portrait Stylization" has been accepted in ACM Transactions on Graphics (to be presented at SIGGRAPH 2022) and our paper "CVFont: Synthesizing Chinese Vector Fonts via Deep Layout Inferring" has been accepted in Computer Graphics Forum (CGF) (Code and data will be available)  

Representative Works:

• Canonical Forms for Non-rigid 3D Shape Retrieval (IJCV 2013, 3DOR 2017)

• 3D Shape Measures (rectilinearity, convexity) (IJCV 2010, CVPR 2012)

• 3D Shape Retrieval Contest (SHREC) (IJCV 2016, PR 2013(ESI Highly Cited Paper) , 3DOR 2015, 14, 11, 10)

• Aesthetic Assessment and Font Recognition for Chinese Characters (CVPR 2017, IJCAI 2015)

• Generation of Chinese Fonts (www.flexifont.com, SIGGRAPH (TOG) 19, 20, SIGGRAPH ASIA (TOG) 19)

• Texture Transfer and Text Effects Transfer (CVPR 18, 19, 20)

Bio:

I was graduated from School of Automation Science and Electrical Engineering, Beihang University in Sep. 2011 with Ph.D. From Jan. 2008 to Jan. 2009, supported by the China Scholarship Council (CSC), I visited School of Computer Science, Cardiff University, UK as a visiting scholar. Then, I worked as a Guest Researcher at the Information Technology Lab (ITL), National Institute of Standards and Technology (NIST), U.S. from Jul. 2009 to Jul. 2011. After that, I came back to China and worked as a postdoctoral researcher at ICST, Peking University, where I became an Assistant Professor in Jun. 2013 and was promoted to Associate Professor in Aug. 2015.

Education:

• 09/2005~06/2011  Ph.D., School of Automation Science and Electrical Engineering, Beihang University, Beijing, China.
• 09/2001~07/2005  B.Eng., College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China.

Working Experience:

• 08/2015~now, Associate Professor, Institute of Computer Science and Technology, Peking University, Beijing, China
• 06/2013~08/2015, Assistant Professor, Institute of Computer Science and Technology, Peking University, Beijing, China
• 07/2011~06/2013, Postdoctoral Researcher, Institute of Computer Science and Technology, Peking University, Beijing, China
• 07/2009~07/2011, Guest Researcher, Information Technology Laboratory, National Institute of Standards and Technology, USA
• 01/2008~01/2009, Academic Visitor, School of Computer Science, Cardiff University, UK

Research:                    Back to top

My research interests include Computer Graphics, Computer Vision, and Artificial Intelligence. More specifically, we have been working on the following topics in the last few years: (1) Font Synthesis; (2) Image Synthesis and Editing; (3) 3D Reconstruction and Novel View Synthesis; (4) Object Detection and Semantic Segmentation.

Students:

PhD Students:

Yitian Liu

Guo Pu

Master Students:

Shilong Li

Bojun Xiong

Hua Li

Xu Liu

Yiming Zhao

Alumni

Zeqing Xia (PhD 2023)

Jialei Cui (Master 2023)

Shiyao Xu(Master 2023)

Zenggui Chen (Master 2023)

Yuqing Wang (Master 2023)

Yizhi Wang (PhD 2022)

Jie Chen (Master 2021)

Yue Gao (Master 2021)

Shuseng Tang (Master 2021)

Tao Sheng (Master 2021)

Xiang Zhang (Master 2021)

Yifang Men (Master 2020)

Xiao Sun (Master 2020)

Yichen Gao (Master 2020)

Wenguan Wang (Master 2020)

Juncheng Liu (PhD 2019)

Yuan Guo (Master 2019)

Yue Jiang (Master 2019)

Xudong Chen (Master 2017)

Chendong Liu (Master 2017)

Weikang Song (Master 2016)

Rongju Sun (Master 2016)

Wanqiong Pan (Master 2015)

Hao Sun (Master 2015)

Jun Zhang (Master 2015)

Wenyan Dong (Master 2015)

Tianyang Yi (Master 2014)

Chenxi Wang (Master 2013)

Yang Liu (Master 2012)

Hongmei Li (Master 2012)

Reading List:

Achievements:                    Back to top

I have published more than 90 academic papers in prestigious journals and conferences (e.g., ToG, TPAMI, IJCV, SIGGRAPH/SIGGRAPH Asia, CVPR, NeurIPS, etc). I was the principal investigator of several projects funded by the National Natural Science Foundation of China, Beijing Nova Program of Science and Technology, etc., and have led our group to successfully develop two practical systems for the generation of Chinese fonts. These systems and techniques related to computer fonts have been adopted by a company called Founder Handwriting since 2016 to create font products that have served millions of users, making significant social and economic benefits. 

Publications (selected):         Back to top

1. 1. G. Pu, Y. Men, Y. Mao, Y. Jiang, W. Ma, Z. Lian*. Controllable Image Synthesis with Attribute-Decomposed GAN. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). 2022 (Accepted) (Code)
   2. C. Xiao, W. Su, J. Liao, Z. Lian, Y. Song, H. Fu. How Differently Do People Sketch 3D Objects? ACM Transactions on Graphics (TOG) (presented at SIGGRAPH Asia 2022) (CCF-A) 
   3. Y. Men, Y. Yao, M. Cui, Z. Lian*, X. Xie. DCT-Net: Domain-calibrated Translation for Portrait Stylization. ACM Transactions on Graphics (TOG). (Accepted)(to be presented at SIGGRAPH 2022) (CCF-A)
   4. Y. Wang, Z. Lian*. DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning. ACM Transactions on Graphics (TOG) (presented at SIGGRAPH Asia 2021) (CCF-A) (Code)
   5. Y. Wang, Y. Gao, Z. Lian*. Attribute2Font: Creating Fonts You Want From Attributes. ACM Transactions on Graphics (TOG) (presented at SIGGRAPH 2020) (CCF-A) (Code)
   6. Z. Lian*, B. Zhao, X. Chen, J. Xiao. EasyFont: A Style Learning based System to Easily Build Your Large-scale Handwriting Fonts. ACM Transactions on Graphics (TOG). vol. 38, no. 1, Article No. 6, 2019 (presented at SIGGRAPH 2019) (CCF-A) (Code&Data)
   7. Y. Gao, Y. Guan, Z. Lian*, Y. Tang, J. Xiao.  Artistic Glyph Image Synthesis via One-Stage Few-Shot Learning. ACM Transactions on Graphics (TOG). vol. 38, no. 6, Article No. 185, 2019 (presented at SIGGRAPH Asia 2019) (CCF-A) (Code)
   8. Z. Lian*, Y. Gao. CVFont: Synthesizing Chinese Vector Fonts via Deep Layout Inferring,  Computer Graphics Forum (CGF), 2022 (Accepted) (CCF-B)
   9. S. Tang, Z. Lian*. Write Like You: Synthesizing Your Cursive Online Chinese Handwriting via Metric-based Meta Learning, Computer Graphics Forum (CGF) (presented at Eurographics 2021) (CCF-B) (Code)
   10. S. Tang, Z. Xia, Z. Lian*, Y. Tang, J. Xiao. FontRNN: Generating Large-scale Chinese Fonts via Recurrent Neural Network,  Computer Graphics Forum (CGF), vol. 38, no. 7, 2019 (CCF-B) (Code)
   11. D. Pickup, X. Sun, P. L. Rosin, R. R. Martin, Z. Cheng, Z. Lian, M. Aono, A. Ben Hamza, A. Bronstein, M. Bronstein, S. Bu, U. Castellani, S. Cheng, V. Garro, A. Giachetti, A. Godil, L. Isaia, J. Han, H. Johan, L. Lai, B. Li, C. Li, H. Li, R. Litman, X. Liu, Z. Liu, Y. Lu, L. Sun, G. Tam, A. Tatsuma, J. Yeshow less. Shape Retrieval of Non-rigid 3D Human Models. International Journal of Computer Vision (IJCV). vol. 120, no. 2, pp. 169-193, 2016 (CCF-A)
   12. Z. Lian*, A. Godil, et al. A Comparison of Methods for Non-rigid 3D Shape Retrieval, Pattern Recognition (PR), vol. 46, no. 1, pp.449-461, 2013 (ESI Highly Cited Paper (top 1%)) (CCF-B) (Data)
   13. Z. Lian*, A. Godil, J. Xiao. Feature-preserved 3D Canonical Form, International Journal of Computer Vision (IJCV), vol. 102, no. 1-3, pp. 221-238, 2013 (CCF-A)
   14. Z. Lian*, P.L. Rosin, X. Sun. Rectilinearity of 3D meshes, International Journal of Computer Vision (IJCV), vol. 89, no. 2-3, pp. 130-151, 2010 (CCF-A)
   15. Y. Liu, Z. Lian*. QT-Font: High-efficiency Font Synthesis via Quadtree-based Diffusion Models, SIGGRAPH 2024 (accepted) (CCF-A)
   16. Y. Men, B. Lei, Y. Yao, M. Cui, Z. Lian, X. Xie. En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Data, CVPR 2024 (accepted) (CCF-A) 
   17. Y. Men, H. Liu, Y. Yao, M. Cui, X. Xie, Z. Lian*, 3DToonify: Creating Your High-Fidelity 3D Stylized Avatar Easily from 2D Portrait Images, CVPR 2024 (accepted) (CCF-A) 
   18. J. Cui, J. Du, W. Liu, Z. Lian*, TextNeRF: A Novel Scene-Text Image Synthesis Method based on Neural Radiance Fields, CVPR 2024 (accepted) (CCF-A) 
   19. Y. Liu, Z. Lian*. DeepCalliFont: Few-shot Chinese Calligraphy Font Synthesis by Integrating Dual-modality Generative Models. AAAI 2024. (Accepted) (CCF-A) 
   20. Y. Luo, Z. Wu, Z. Lian*, CalliRewrite: Recovering Handwriting Behaviors from Calligraphy Images without Supervision, ICRA 2024 (accepted) (CCF-B) (Code)
   21. G. Pu, P.-S. Wang, Z. Lian*. SinMPI: Novel View Synthesis from a Single Image with Expanded Multiplane Images. SIGGRAPH Asia 2023
   22. Y. Wang, Y. Wang, L. Yu, Y. Zhu, Z. Lian*. DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Quality. CVPR 2023 (accepted) (CCF-A)
   23. Z. Xia, B. Xiong, Z. Lian*. VecFontSDF: Learning to Reconstruct and Synthesize High-quality Vector Fonts via Signed Distance Functions. CVPR 2023 (accepted) (CCF-A)
   24. Z. Chen, Z. Lian*. Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning. ACM MM 2022 (CCF-A) 
   25. Y. Wang, G. Pu, W. Luo, Y. Wang, P. Xiong, H. Kang, Z. Lian*. Aesthetic Text Logo Synthesis via Content-aware Layout Inferring. CVPR 2022 (CCF-A) (Code)
   26. Y. Men, Y. Yao, M. Cui, Z. Lian, X. Xie, X. Hua. Unpaired Cartoon Image Synthesis via Gated Cycle Mapping. CVPR 2022(CCF-A)
   27. T. Sheng, J. Chen, Z. Lian*. CentripetalText: An Efficient Text Instance Representation for Scene Text Detection, NeurIPS 2021 (CCF-A) (Code)
   28. Y. Gao, F. Wei, J. Bao, S. Gu, D. Chen, F. Wen, Z. Lian*. High-Fidelity and Arbitrary Face Editing, CVPR 2021 (CCF-A)
   29. X. Zhang, X. Sun, Z. Lian*. BoW Pooling: A Plug-and-Play Unit for Feature Aggregation of Point Clouds, AAAI 2021 (CCF-A)
   30. Y. Liu, Z. Lian*. FontRL: Chinese Font Synthesis via Deep Reinforcement Learning, AAAI 2021 (CCF-A)
   31. Y. Men, Y. Mao, Y. Jiang, W. Ma, Z. Lian*. Controllable Person Image Synthesis with Attribute-Decomposed GAN. CVPR 2020, pp. 5084-5093, 2020 (Oral, Acceptance rate 5.7%) (CCF-A) (Code)
   32. Y. Wang, Z. Lian*. Exploring Font-independent Features for Scene Text Recognition. ACM MM, 2020 (CCF-A) (Code)
   33. X. Sun, Z. Lian*, J. Xiao, SRINet: Learning Strictly Rotation-Invariant Representations for Point Cloud Classification and Segmentation, ACM MM, 2019 (CCF-A)
   34. Y. Jiang, Z. Lian*, Y. Tang, J. Xiao. SCFont: Structure-guided Chinese Font Generation via Deep Stacked Networks, AAAI 2019 (CCF-A)
   35. Y. Men, Z. Lian*, Y. Tang, J. Xiao. DynTypo: Example-based Dynamic Text Effects Transfer. CVPR 2019, pp. 5870-5879, 2019 (CCF-A)
   36. Y. Men, Z. Lian*, Y. Tang, J. Xiao. A Common Framework for Interactive Texture Transfer. CVPR 2018, pp. 6353-6362, 2018 (Spotlight, Acceptance rate 6.7%) (CCF-A)
   37. J. Liu, Z. Lian*, Y. Wang, J. Xiao. Incremental Kernel Null Space Discriminant Analysis for Novelty Detection. CVPR 2017, pp. 792-800, 2017 (CCF-A)  (Data&Code)
   38. S. Yang, J. Liu, Z. Lian, Z. Guo. Awesome Typography: Statistics-Based Text Effects Transfer. CVPR 2017, pp. 2886-2895 (CCF-A)
   39. R. Sun, Z. Lian*, Y. Tang, J. Xiao. Aesthetic Visual Quality Evaluation of Chinese Handwritings. IJCAI 2015, pp. 2510-2516, 2015 (CCF-A) (Data)
   40. Z. Lian*, A. Godil, P.L. Rosin, X. Sun. A New Convexity Measurement for 3D Meshes, CVPR 2012, pp. 119-126, 2012 (CCF-A)

Full list

Courses:       Back to top

1. Spring (2014~now): Elementary Number Theory

2. Fall (2017~now): Intelligent Optimization Methods