IEEE SMC: Systems, Man, & Cybernetics Society

Human Perception in Multimedia Computing

TC Leadership

Guillaume Lavoué

TC Co-Chair

Guillaume Lavoué
University of Lyon, France

Haohong Wang

TC Co-Chair

Haohong Wang
TCL Research America, USA

Our Goal

Our goal is to demonstrate how human perception of multimedia can lead to enhanced practical systems, and how human study and user experience innovation can foster the multimedia computing system development. Human perception has been studied extensively and for a long time in psychology, but only in the late twentieth century has it emerged as a research area in computer graphics, image processing, computer vision, multimedia communication, and related disciplines. From the human-computer interface (HCI) perspective, audio and visual data can trigger conscious and unconscious user responses. The perceptual approach assumes that perceived quality is essential provided it is noticeable to the human visual system (HVS); details that do not enhance perceived quality only waste computational and network resources. Experiments assessing the limitation of the human visual system show that multimedia applications can take advantage of these human perceptual limits. With the emerging areas of social computing, mobile sensing, crowdsourcing, and so on, the perceptual approach and QoE optimization technology can be applied in conjunction to achieve higher system efficiency. The following are some of the topics that fall within the scope of our TC:

Human Perception and Visual Quality

  • Human perceptual quality measurement
  • Quality metrics for multimedia (image, graphics, video…)
  • Perceptual quality aware visual processing and rendering
  • Perceptual quality aware visual data compression
  • Perceptual quality aware visual communications
  • Perceptual factors in multimedia education
  • Panoramic view perception, capture and rendering

Human-Oriented Multimedia Computing

  • Human factors in 3D and multimedia systems
  • Human behavior modeling and understanding
  • Computer vision and media data analysis
  • Social multimedia computing
  • Media recommender systems
  • Human-based sensing and data mining

Advanced Multimedia User Experiences

  • Quality of Experiences (QoE) models
  • Novel interactive multimedia systems
  • Multimodal user interfaces and interaction models
  • Augmented reality algorithms and applications
  • Gesture and touch based systems and applications

Human and Mobile Media

  • Mobile sensing for media capturing and processing
  • Low-power media processing and communications
  • Human interaction with mobile applications
  • Seamless Human centric computing and communications
  • Crowdsourcing in media applications

We play significant roles in a variety of important conferences and journals related to TC scope, including IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE International Conference on Multimedia and Expo (ICME), IEEE International Symposium on Multimedia (ISM), IEEE Global Communications Conference (GLOBECOM), ACM Symposium on Applied Perception (ACM SAP), ACM International Conference on Multimedia (ACM MM), ACM International Conference on 3D Web Technology (Web3D), Eurographics, Shape Modeling International (SMI), International Conference on Computing, Networking and Communications (ICNC), International Conference on Computer Communications and Networks (ICCCN), IEEE Transactions on Systems, Man, and Cybernetics, IEEE Transactions on Multimedia, IEEE Communications Magazine, IEEE SMC eNewsletter, ACM Multimedia Systems Journal, ACM Transactions on Applied Perception, Computer Graphics Forum, Journal of Communications.

Join Us

The Technical Committee on Human Perception and Multimedia Computing provides opportunities to continue professional and personal development, such as:

  • Interactions with experts from different disciplines related to human perception and multimedia
  • Participation in interesting conferences and workshops
  • Publication in high-quality journals
  • Exchanges of research ideas and sharing of research resources

Learn More

These tutorial materials provide more information on topics of interest to our technical committee.

Recent Activities

  • Regular special sessions at IEEE SMC conferences.
  • Strongly involved in the organization of SMC 2014 (Short Paper, Demo and Exhibit programs).
  • Serving as Associate Editor for IEEE Transactions on Human Machine Systems.
  • Organized the 2011 and 2013 editions of the IEEE International Conference on Multimedia and Expo (ICME).
  • Special issue on “3D Imaging Techniques and Multimedia Applications” for the IEEE IEEE Multimedia Magazine, 2013.
  • Strongly involved in the organization of the 2012 International Conference on Computing, Networking and Communications (ICNC).
  • Special issue on “Emerging Techniques in 3D: 3D Data Fusion, Motion Tracking in Multi-view Video, 3DTV Archives and 3D Content Protection” for the IEEE J-Selected Topics in Signal Processing (J-STSP), September 2012.
  • Workshop on Adaptive Collaboration, ACM/IEEE International Conference on Collaborative Technologies and Systems, Denver, USA, May 2012.
  • State-of-the-art on Perceptual Quality Metrics at Eurographics 2012.
  • Workshop on “Human-Focused Communications in the 3D Continuum”, IEEE ICME 2012.
  • Workshop on “Vision and Graphics Computing for Multimedia Communications”, IEEE ICME 2011.
  • Special issue on “Holonic Manufacturing Systems” for the IEEE Transactions on Systems, Man, and Cybernetics, Part C, January 2011.
  • Articles on professional activities of our members for submission to the SMC eNewsletter
  • Technical papers for submission to the IEEE Transactions on Systems, Man, and Cybernetics.
  • Reviewing of articles submitted to IEEE Transactions on Systems, Man, and Cybernetics.

Members

  • Aydin Alatan, Middle East Technical University, Turkey
  • Yiannis Aloimonos, University of Maryland-College Park, US
  • Carlos Alexandre Barros de Mello, Federal University of Pernambuco (CIn/UFPE), Brazil
  • Vijayan K. Asari, Professor in Electrical and Computer Engineering, Director, UD Vision Lab, University of Dayton, OH, USA
  • Anup Basu, University of Alberta, Canada
  • Walter F. Bischof, University of Alberta, Canada
  • Zhibo Chen, Research Director, Technicolor Research & Innovation, China
  • Shenyong (Steven) Chen, Zhejiang University of Technology, China
  • Irene Cheng, Uniersity of Alberta, Canada
  • Massimiliano Corsini, ISTI-CNR, Pisa, Italy
  • Guido Maria Cortelazzo, University of Padova, Italy
  • Chenwei Deng, Beijing Institute of Technology, China
  • Abdulmotaleb El Saddik, University of Ottawa, Canada
  • Gabriel Fernández, Ramon Llull University-La Salle, Spain
  • Oscar Garcia, Ramon Llull University-La Salle, Spain
  • Enrico Gobbetti, Center for Advanced Studies, Research and Development, Sardinia, Italy
  • Rumi Hiraga, Tsukuba University of Technology, Japan
  • Michail Iliadis, Northwestern University, USA
  • Cai Jianfei, NTU, Singapore
  • Armin Kappeler, Northwestern University, USA
  • Chaker Larabi, University of Poitiers, France
  • Ze-Nian Li, Simon Fraser University, Canada
  • Zhao Li, TCL Research America, USA
  • Hantai Liu, University of Hull, UK
  • Yu Liu, National University of Defense Technology Changsha, People’s Republic of China
  • Lin Ma, The Chinese University of Hong Kong
  • Khaled El-Maleh, Qualcomm Inc., USA
  • Rafal Mantiuk, Bangor University, UK.
  • King Ngi Ngan, The Chinese University of Hong Kong
  • Shahram Payandeh, Simon Fraser University, Canada
  • Holly Rushmeier,Yale University, USA
  • Guan-Ming Su, Dolby Labs, USA
  • Lingfen Sun,University of Plymouth, UK
  • Claudio Silva, New York University, USA
  • Ping Tan, National University of Singapore, Singapore
  • ShuRen Tan, National University of Defense Technology, Changsha, People’s Republic of China
  • Dacheng Tao, University of Technology Sydney, Australia
  • Lluis Vicent, Ramon Llull University-La Salle, Spain
  • Zhihui Xiong, National University of Defense Technology Changsha, People’s Republic of China
  • Wei Wang, National University of Defense Technology Changsha, People’s Republic of China
  • Kai Wang, Gipsa-lab, Grenoble, France
  • Lin Weisi, Nanyang Technological University
  • Jonathan Wu, University of Windsor, Canada
  • Yimin Yang, Florida International University, USA
  • Si Yong Yeo, Institute of High Performance Computing, Singapore
  • Xenophon Zabulis, Foundation for Research and Technology – Hellas (FORTH), Greece
  • Pietro Zanuttigh, University of Padova, Italy
  • Maojun Zhang, National University of Defense Technology Changsha, People’s Republic of China
  • Fan Zhai, Qualcomm, USA

Back to top