报告题目：Social Multimedia as Sensors

报告人：罗杰波教授，Fellow of the IEEE, SPIE and IAPR

时间：2016年6月13日（周一）下午3:00-4:30

地点：北京大学计算机科学技术研究所1层106会议室

Abstract: Increasingly rich and large-scale social multimedia data (including text, images, audio, video) are being generated and posted to social networking and media sharing websites. Researchers from multidisciplinary areas are developing methods for processing social multimedia and employing such rich multi-modality data for various applications. We present a few recent advances in the area of using social multimedia as sensors. Specifically, this tutorial consists of two parts. The first part is on sensing users from heterogeneous, complex, and dynamic social multimedia. We will introduce four elements in the loop of sensing users' user profile, context, multi-modal input, and interactivity. In particular, we will address estimation of user profile, accurate and comprehensive estimation of a mobile user's geo-context from phone-captured photos, and personalized mobile recommendation based on context information. The second part is about sensing social activities from user-generated social multimedia contents, including suggesting suitable social groups from a user's personal photo collection, producing popular and diverse tourism routes from crowd-sourced geo-tagged photos, extracting user sentiment from both textual and visual information in social media, and forecasting election outcome based on image sharing activities and image sentiments. In addition, we will also share interesting findings regarding cultural differences in social multimedia between US and China, as well as thoughts on current challenges and future directions.

Biography: Jiebo Luo joined the University of Rochester in Fall 2011 after over fifteen prolific years at Kodak Research Laboratories, where he was a Senior Principal Scientist leading research and advanced development. He has been involved in numerous technical conferences, including serving as the program co-chair of ACM Multimedia 2010 and IEEE CVPR 2012. He is the Editor-in-Chief of the Journal of Multimedia, and has served on the editorial boards of the IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE Transactions on Multimedia, IEEE Transactions on Circuits and Systems for Video Technology, Pattern Recognition, Machine Vision and Applications, and Journal of Electronic Imaging. Dr. Luo is a Fellow of the SPIE, IEEE, and IAPR.

His research spans image processing, computer vision, machine learning, data mining, medical imaging, and ubiquitous computing. He has been an advocate for contextual inference in semantic understanding of visual data, and continues to push the frontiers in this area by incorporating geo-location context and social context. A recent research thrust focuses on exploiting social media for machine learning, data mining, and human-computer interaction, for example, mining the wisdom of crowds for social, political, and economic prediction and forecasting. He has published extensively in these fields with over 270 papers and 90 US patents.