photo

Qianru Sun 孙倩茹

I am an Assistant Professor (Tenure Track) in the School of Information Systems, Singapore Management University. From 2018 to 2019, I was a Joint Research Fellow working with Prof. Tat-Seng Chua at the National University of Singapore and Prof.Dr. Bernt Schiele at the MPI for Informatics. From 2016 to 2018, I held the Lise Meitner Award Fellowship and worked with Prof.Dr. Bernt Schiele and Prof. Dr. Mario Fritz at the MPI for Informatics. I got my Ph.D. degree from Peking University in 2016 and my thesis was advised by Prof. Hong Liu. In 2014, I was a visiting student advised by Prof. Tatsuya Harada at the University of Tokyo. My research interests are computer vision and machine learning that aim to develop efficient algorithms and systems for visual understanding.

 qianrusun AT smu DOT edu DOT sg
 80 Stamford Rd, Singapore 178902

 News

  •    The extended paper of our CVPR'19 work (MTL) is accepted to IEEE Trans. on PAMI.
  •    Two papers respectively about semantic segmentation and few-shot learning are accepted to ECCV'20.
  •    Our paper about the application of teacher-student networks is accepted to IJCAI'20.
  •    We release the code of E3BM (SOTA few-shot learning results and LITTLE overhead costs)! [github]
  •    We release the code of Mnemonics Training (SOTA multi-class incremental learning results on ImageNet)! [github]
  •    We release the code of VC R-CNN (SOTA image representation on MS-COCO Detection and Open Images)! [github]
  •    Two papers respectively about incremental learning (oral presentation) and unsupervised learning are accepted to CVPR'20.
  •    We will host the ACM Multimedia Asia 2020 conference in Singapore! Paper submission deadline: 21 Sep 2020. [homepage]
  •    An article about my research is posted on "Research at SMU Nov 2019 Issue". [info]
  •    Our paper about semi-supervised few-shot learning is accepted to NeurIPS'19.
  •    Our paper about mixed-dish image recognition is accepted to ACM Multimedia'19.
  •    Our paper about visual relationship feature augmentation is accepted to BMVC'19.
  •    Our paper about few-shot learning is accepted to CVPR'19.

 Research

  •    Computer Vision: image recognition, image generation, person re-identification, human action recognition
  •    Machine Learning: meta-learning, incremental learning, semi-supervised learning, unsupervised learning

 Projects

  •    Oct 2019 - Mar 2021     Fine-Grained Food Image Recognition (SINGAPORE NATIONAL RESEARCH FOUNDATION)
  •    Mar 2020 - Feb 2021     Automated Deep Neural Network Initiation (ALIBABA GROUP)
  •    Mar 2020 - Feb 2021     Class-Incremental Learning System (SINGAPORE MOE TIER 1 GRANT)

 Teaching

  •    2020/2021   Term1   IS111-Introduction to Programming (Sections G11, W1-15)
  •    2019/2020   Term2   IS112-Data Management (Sections G12-13, W1-15)
  •    2019/2020   Term1   IS111-Introduction to Programming (Sections G8-9-12, W1-4)

 Service

  •    ACM MM Asia'20 (March 2021), Organization Committee (Program Chair)
  •    NeurIPS'20, ECCV'20, IJCAI'20, AAAI'20, CVPR'20'19'18, ICCV'19'17, Program Committee
  •    IEEE Trans on PAMI/TMM/TCSVT/TIP/NNLS, IJCV, PR, PR Letters, Reviewer
  •    Neural Processing Letters, Guest Editor
  •    CAAI Transactions on Intelligence Technology, Guest Editor
  •    Lise Meitner Award Fellowship (MPII) 2018, Organization Committee

 PhD Students

  •    Jan 2020 -    Zhaozheng Chen, Singapore Management University
  •    Jan 2020 -    Chunhui Bao, Singapore Management University
  •    Sep 2019 -    Sicheng Yu, Singapore Management University (with Prof. Jing Jiang)
  •    Jun 2018 -    Yaoyao Liu, MPI for Informatics (with Prof.Dr. Bernt Schiele)

 Visiting PhD Students

  •    Sep 2020 - Aug 2021    Xin Zhao, Jilin University
  •    Jan 2020 - Dec 2020    Xin Fu, Beijing Jiaotong University
  •    Nov 2019 - Oct 2021    Wei Qin, Hefei University of Technology

 Selected Talks

  •    Jul 2020, CSIAM Big Data & AI Forum. "Learning to Learn" [slides]
  •    Jan 2018, ICMR 2018 Tutorial. "Objects, Relationships, and Context in Visual Data" [slides]
  •    Dec 2017, DVMM Lab at Columbia University. "Pose Guided Person Image Generation" [slides]
  •    Jul 2017, CVPR 2017 ODAR Workshop. "Domain Based Social Relation Recognition" [slides]
  •    Jul 2017, MPII & Saarland University. "Your Photos Expose Your Social Life" [slides]

 Publications

 Technical Reports

Joint Visual Grounding with Language Scene Graphs
Daqing Liu, Hanwang Zhang, Zheng-Jun Zha, Meng Wang, Qianru Sun
arXiv, 9 Jun 2019.
[paper]

A Novel BiLevel Paradigm for Image-to-Image Translation
Liqian Ma, Qianru Sun, Bernt Schiele, Luc Van Gool
arXiv, 18 Apr 2019.
[paper]

Learning a Disentangled Embedding for Monocular 3D Shape Retrieval and Pose Estimation
Kyaw Zaw Lin, Weipeng Xu, Qianru Sun, Christian Theobalt, Tat-Seng Chua
arXiv, 26 Mar 2019.
[paper]

 2020

Meta-Transfer Learning through Hard Tasks
Qianru Sun, Yaoyao Liu, Zhaozheng Chen, Tat-Seng Chua, Bernt Schiele
IEEE Transactions on Pattern Analysis and Machine Intelligence, 21 Aug 2020.
doi:10.1109/TPAMI.2020.3018506
[pre-print]

Feature Pyramid Transformer
Dong Zhang, Hanwang Zhang, Jinhui Tang, Meng Wang, Xian-Sheng Hua, Qianru Sun
European Conference on Computer Vision, ECCV'20. (26%)
[paper] [code]

An Ensemble of Epoch-wise Empirical Bayes for Few-shot Learning
Yaoyao Liu, Bernt Schiele, Qianru Sun
European Conference on Computer Vision, ECCV'20. (26%)
[paper] [code]

Teacher-Student Networks with Multiple Decoders for Solving Math Word Problem
Jipeng Zhang, Roy K. Lee, Ee-peng Lim, Wei Qin, Lei Wang, Jie Shao, Qianru Sun
The 29th International Joint Conference on Artificial Intelligence -. , IJCAI'20. (12.6%)
[paper] [code]

Mnemonics Training: Multi-Class Incremental Learning without Forgetting
Yaoyao Liu, Yuting Su, An-An Liu, Bernt Schiele, Qianru Sun
The 33rd Conference on Computer Vision and Pattern Recognition, CVPR'20. (Oral Presentation, 4%)
[paper] [supp.] [video] [code]

Visual Commonsense R-CNN
Tan Wang, Jianqiang Huang, Hanwang Zhang, Qianru Sun
The 33rd Conference on Computer Vision and Pattern Recognition, CVPR'20. (22%)
[paper] [supp.] [video] [code]

Generating Face Images with Attributes for Free
Yaoyao Liu, Qianru Sun, Xiangnan He, An-An Liu, Yuting Su, Tat-Seng Chua
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 20 July 2020.
DOI: 10.1109/TNNLS.2020.3007790
[paper] [code]

 2019

Learning to Self-Train for Semi-Supervised Few-Shot Classification
Xinzhe Li, Qianru Sun, Yaoyao Liu, Shibao Zheng, Tat-Seng Chua, Bernt Schiele
The 33rd Annual Conference on Neural Information Processing Systems, NeurIPS'19.
[paper] [slides] [poster] [code]

Generating Expensive Relationship Features from Cheap Objects
Xiaogang Wang, Qianru Sun, Tat-Seng Chua, Marcelo H.Jr. Ang
The 30th British Machine Vision Conference, BMVC'19.
[paper] [poster] [code]

Meta-Transfer Learning for Few-Shot Learning
Qianru Sun, Yaoyao Liu, Tat-Seng Chua, Bernt Schiele
The 32nd Conference on Computer Vision and Pattern Recognition, CVPR'19.
[paper] [poster] [code]

Mixed-dish Recognition with Contextual Relation Networks
Lixi Deng, Jingjing Chen, Qianru Sun, Xiangnan He, Tat-Seng Chua
The 27th ACM International Conference on Multimedia, ACM MM'19.
[paper] [code]

 2018

A Hybrid Model for Identity Obfuscation by Face Replacement
Qianru Sun, Ayush Tewari, Weipeng Xu, Mario Fritz, Christian Theobalt, Bernt Schiele
The 15th European Conference on Computer Vision, ECCV'18.
[paper] [decoder code]

Disentangled Person Image Generation
Liqian Ma, Qianru Sun, Stamatios Georgoulis, Luc Van Gool, Bernt Schiele, Mario Fritz
2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR'18. (Spotlight Presentation)
[paper] [code] [project]

Natural and Effective Obfuscation by Head Inpainting
Qianru Sun, Liqian Ma, Seong Joon Oh, Luc Van Gool, Bernt Schiele, Mario Fritz
2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR'18.
[paper] [decoder code] [PDM code]

 2017

Pose Guided Person Image Generation
Liqian Ma, Xu Jia, Qianru Sun, Bernt Schiele, Tinne Tuytelaars, Luc Van Gool
The 31st Annual Conference on Neural Information Processing, NIPS'17.
[paper] [slides] [code]

A Domain Based Approach to Social Relation Recognition
Qianru Sun, Bernt Schiele, Mario Fritz
2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR'17.
[paper] [code] [project]

Online Growing Neural Gas for Anomaly Detection in Changing Surveillance Scenes
Qianru Sun, Hong Liu, Tatsuya Harada
Pattern Recognition. April 2017, Volume 64, Pages 187-201.
[paper]

 Before 2017

 Reference