Systems and applications
- Teleconferencing, telepresence, tele-immersion, immersive environments
- Virtual classrooms and distance learning
- Multimodal collaboration, online multiplayer gaming, social networking
- Telemedicine, human-human distance collaboration, multimodal storage and retrieval
Multimedia for communication and collaboration
- Ad hoc broadband sensor array processing
- Microphone and camera array processing
- Automatic sensor calibration, synchronization
- Source separation, source localization, de-noising, enhancement, spatialization
Scene analysis for immersive telecommunication and human collaboration
- Audiovisual scene analysis
- Object detection, identification, and tracking
- Gesture, face, and human pose recognition
- Presence detection and activity classification
- Multimodal sensor fusion
Coding
- Distributed/centralized source coding for sensor arrays
- Scalable source coding for multiparty conferencing
- Error/loss resilient coding for telecommunications, channel coding and error protection
Networking
- Voice and video over IP and wireless, quality monitoring and management, security
- Priority-based QoS control and scheduling, ad-hoc and real time communications
- Channel coding, packetization, synchronization, buffering