I am Quanzeng You. Currently, I am a principal researcher at Microsoft Azure Computer Vision Science Group. I received my Ph.D. degree from Department of Computer Science, University of Rochester. My Ph.D. advisor is Prof. Jiebo Luo. I am broadly interested in computer vision, deep learning and multimedia content understanding.

Quanzeng You

quanzeng.you at outlook.com

quanzeng.you at microsoft.com

Principal Researcher
Azure Computer Vision Science


Computer Vision Spatial Analysis
Working at Microsoft Azure Computer Vision Science team. We collaborate with other teams on Real-time Computer Vision Spatial Analysis. Real-time Multi-Camera Multiple Object Tracking System
  • Quanzeng You and Hao Jiang. "Real-time 3D Deep Multi-Camera Tracking." arXiv preprint arXiv:2003.11753 (2020).
  • Demo video of our sytem on our dataset.
  • Demo video of our sytem on WILDTRACK.
4D Vision System
Worked with Dr. Hao Jiang. We developed 4D algorithms, which use multiple calibrated RGBD cameras for multiple people tracking, action recognition and 3D body parts localization.


For a full list of my publications, please check my Google Scholar.
  • Hao Jiang, Quanzeng You, Zhengyou Zhang. 4d tracking. US Patent App. 15/974,370, 2019.
  • Zhaowen Wang, Quanzeng You, Hailin Jin, Chen Fang. Semantic natural language vector space. US 9,792,534, 2017.
  • Zhaowen Wang, Quanzeng You, Hailin Jin, Chen Fang. Image captioning with weak supervision. US Patent 9,811,765, 2017.
  • Quanzeng You, Sumit Bhatia. User characteristic prediction using images posted in online social networks. US Patent 9,489,592, 2016.
Peer-reviewed conference and preprint
  • Quanzeng You, Hao Jiang. Real-time 3D Deep Multi-Camera Tracking, 2020.
  • Hao Jiang, Quanzeng You. Real-time Multiple People Hand Localization in 4D Point Clouds. arXiv preprint arXiv:1903.01695, 2019.
  • Quanzeng You, Hao Jiang. Action4D: Online Action Recognition in the Crowd and Clutter. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 11857-11866.
  • Fenglong Ma, Jing Gao, Qiuling Suo, Quanzeng You, Jing Zhou and Aidong Zhang. Risk Prediction on Electronic Health Records with Prior Medical Knowledge.KDD 2018, London, United Kingdom, August 2018.
  • Fenglong Ma, Quanzeng You, Houping Xiao, Radha Chitta, Jing Zhou and Jing Gao. KAME: Knowledge-based Attention Model for Diagnosis Prediction in Healthcare. CIKM 2018, October 22-26, 2018.
  • Tianlang Chen, Zhongping Zhang, Quanzeng You, Chen Fang, Zhaowen Wang, Hailin Jin, Jiebo Luo. Factual or Emotional: Stylized Image Captioning with Adaptive Learning and Attention. ECCV 2018.
  • Quanzeng You, Hailin Jin, Jiebo Luo. Image captioning at will: A versatile scheme for eectively injecting sentiments into image descriptions. arXiv preprint arXiv:1801.10121.
  • Yuxiao Chen, Jianbo Yuan, Quanzeng You, Jiebo Luo. Twitter sentiment analysis via bi-sense emoji embedding and attention-based LSTM. In Proceedings of the 26th ACM international conference on Multimedia (ACM-MM) (pp. 117-125), 2018.
  • Quanzeng You, Zhengyou Zhang, Jiebo Luo. End-to-end Convolutional Semantic Embeddings, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, June 2018.
  • Tianran Hu, Anbang Xu, Zhe Liu, Quanzeng You, Yufan Guo, Vibha Sinha, Jiebo Lu, Rama Akkiraju. Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media. SIGCHI, 2018.
  • Fenglong Ma, Radha Chitta, Jing Zhou, Quanzeng You, Tong Sun, Jing Gao. Dipole: Diagnosis Prediction in Healthcare via Attention-based Bidirectional Recurrent Neural Networks. KDD 2017, Halifax, Nova Scotia - Canada, August 2017.
  • Quanzeng You, Jungseock Joo, Dario Garcia Garcia, Jiebo Luo. Cultural Dynamics and Trends in Facebook Photographs, AAAI International Conference on Web and Social Media (ICWSM), 2017.
  • Quanzeng You, Hailin Jin and Jiebo Luo. Visual Sentiment Analysis by Attending on Local Image Regions, 31-th AAAI Conference on Articial Intelligence (AAAI-17), San Francisco, CA. 2017.
  • Quanzeng You. Sentiment and Emotion Analysis for Social Multimedia: Methodologies and Applications, ACM Multimedia Conference (ACM MM), Doctoral Symposium, Amsterdam, The Netherlands, October 2016.
  • Quanzeng You, Liangliang Cao, Hailin Jin, Jiebo Luo. Robust Visual-Textual Sentiment Analysis: When A tion meets Tree-structured Recursive Neural Networks, ACM Multimedia Confe e (ACM MM), Amsterdam, The Netherlands, October 2016.
  • Quanzeng You, Hailin Jin, Zhaowen Wang, Chen Fang, Jiebo Luo. Image Captioning with Semantic At ion, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vega V, June 2016.
  • Quanzeng You, Hailin Jin, Jianchao Yang, Jiebo Luo. Building a Large Scale Dataset for Image Emotio cognition: The Fine Print and The Benchmark. AAAI, 2016.
  • Quanzeng You, Jiebo Luo, Hailin Jin and Jianchao Yang. Cross-modality Consistent Regression for J Visual-Textual Sentiment Analysis of Social Multimedia. The 9th International Co ence on Web Search and Data Mining (WSDM), 2016.
  • Quanzeng You, Hailin Jin, Jianchao Yang and Jiebo Luo. Cross-modality Consistent Regression for J Visual-Textual Sentiment Analysis, ACM MM (short) 2015.
  • Danning Zheng, Tianran Hu, Quanzeng You, Henry Kautz and Jiebo Luo. Towards Lifestyle Unders ing: Predicting Home and Vacation Locations from User's Online Photo Collection CWSM, 2015
  • Quanzeng You, Jianbo Yuan, Jiaqi Wang, Philip Guo and Jiebo Luo. Snap n' Shop: Visual Search-Ba Mobile Shopping Made a Breeze by Machine and Crowd Intelligence, ICSC, 2015.
  • Quanzeng You, Jiebo Luo, Hailin Jin and Jianchao Yang. Robust Image Sentiment Analysis Using P essively Trained and Domain Transferred Deep Networks, AAAI, 2015.
  • Quanzeng You, Sumit Bhatia, Tong Sun, Jiebo Luo. The eyes of the beholder: Gender prediction using images posted in online social networks, IEEE ICDM, Workshop on Social Multimedia Data Mining, 2014.
  • Danning Zheng, Tianran Hu, Quanzeng You, Henry Kautz, Jiebo Luo. Inferring Home Location from User's Photo Collections based on Visual Content and Mobility Patterns, ACM MM, Workshop Geotagging and Its Applications in Multimedia, 2014.
  • Junhuan Zhu, Quanzeng You, Jiebo Luo and John R. Smith, Towards Understanding the Effectiveness of collection Related Images in Social Media, ICDM Workshop DDM, December 2013.
  • Jianbo Yuan, Quanzeng You, and Jiebo Luo, Are There Cultural Dierences in Event Driven Information propagation Over Social Media? ACM MM Workshop IWSAM, October 2013.
  • Quanzeng You and Jiebo Luo, Towards Social Imagematics: Sentiment Analysis in Social Multimedia, ACM DD, Workshop on MDM, August 2013.
  • Jianbo Yuan, Quanzeng You, Sean McDonough, and Jiebo Luo, Sentribute: Image Sentiment Analysis from a level Perspetive, ACM SIGKDD, Workshop WISDOM, August 2013.
  • Xianchao Zhang, Quanzeng You. Clusterability Analysis and Incremental Sampling for Nystrom Extension Based Spectral Clustering. ICDM, 942-951, 2011.
  • Liu Tianliang, Wan Junwei, Dai Xiubin, Feng Liu, Quanzeng You, Jiebo Luo. Sentiment Recognition for t Annotated GIFs Using Visual-Textual Fusion. IEEE Transactions on Multimedia, 2
  • Quanzeng You, Ran Pang, Liangliang Cao and Jiebo Luo. Image Based Appraisal of Real Estate PropertieEEE Transactions on Multimedia (TMM), 2017.
  • Yang Cong, Ji Liu, Gan Sun, Quanzeng You, Yuncheng Li, and Jiebo Luo. Adaptive Greedy Dictionarlection for Web Media Summarization, in IEEE Transactions on Image Processing, vol.no.99, pp.1-1. doi: 10.1109/TIP.2016.2619260
  • Xianchao Zhang, Linlin Zong, Quanzeng You, Xing Yong. Sampling for Nystrom Extension based Spectral Cering: Incremental Perspective and Novel Analysis. IEEE Transactions on ledge DIscovery from Data (TKDD), 2016.
  • Quanzeng You, Sumit Bhatia, Jiebo Luo. Picture Tells a Thousand Words{About You! User Interest Prg from User Generated Visual Content.Signal Processing, 2016.
  • Quanzeng You, Liangliang Cao, Yang Cong, Xianchao Zhang, Jiebo Luo. A Multifaceted Approach to Sociultimedia-based Prediction of Elections. IEEE Transactions on Multimedia (T 2015.
  • Quanzeng You, John Krumm. Transit tomography using probabilistic time geography: planning routes out a road map, Journal of Location Based Services, 3(97):1-18, 2014.
  • Xianchao Zhang, Quanzeng You. An Improved Spectral Clustering Based on Random Walk. Frontiers of Computer Science in China, vol. 5, no. 3, pp. 268-278.


We have built several datasets for sentiment analysis and emotion analysis. However, my previous homepage has been deleted by URCS. I try my best to recover those datasets from other partially backup locations. Hopefully, this may offer some help for those who are interested in using these datasets for their research.
Plain Academic