Overview
IEC TR 63669:2026 "Alignment of heterogeneous media data streams" is a technical report from the International Electrotechnical Commission (IEC) that addresses the challenges encountered when combining diverse media data types in modern multimedia services. As digital technologies advance, the integration of new media types-such as sensor signals, haptic feedback, 360° video, and 3D audio-has outpaced existing international standards, which were traditionally designed for video and audio integration. This lack of standardization often leads to interoperability issues, limited scalability, and the formation of data silos.
IEC TR 63669:2026 examines current technologies and relevant standards, proposes a conceptual model for aligning heterogeneous media streams, and identifies key items for future standardization. By enabling seamless alignment and integration, this document lays the foundation for next-generation multimedia services and applications.
Key Topics
-
Heterogeneous Media Data Streams
- Inclusion of conventional (video, audio, text) and emerging media types (sensor data, haptic data, geospatial information).
- Importance of synchronizing and integrating data streams from various sources in real time.
-
Three-layer Model for Data Alignment
- Input Layer: Receives diverse data streams (video, audio, sensors), each with its specific format and metadata.
- Process Layer: Aligns different streams via order (timestamp, sequence), attaches metadata, and manages relationships.
- Output Layer: Delivers the aligned multimedia data, supporting flexible querying and replay (by time or space).
-
Challenges Identified
- Lack of standardized data formats for new media types.
- Absence of unified methods for time and space alignment across streams.
- Scarcity of protocols and schemas for dynamic, multi-modal data integration.
-
Potential Standardization Areas
- Stream alignment methods (sequence, timestamp, spatial coordinates).
- Schema and metadata definitions for heterogeneous streams.
- Formats and protocols for flexible output and cross-platform interoperability.
Applications
The standard enhances multimedia services by addressing the alignment and integration of heterogeneous data. Typical application areas include:
-
Photorealistic Virtual Worlds
- Example: Virtual city exploration or cultural heritage tours using integrated 360° video, geospatial data, and AR overlays.
- Value: Offers immersive, interactive user experiences that go beyond time-based navigation, enabling spatial queries and custom interactions.
-
Interactive 3D Multimedia Content
- Example: Virtual music events recorded with multiple 360° cameras and object-based 3D audio.
- Value: Allows for highly immersive environments where users can change viewpoints, navigate space, and interact with multimedia elements seamlessly.
-
Remote Collaboration Systems
- Example: Remote work guidance using video, audio, and real-time sensor data (e.g., hand gesture tracking, orientation).
- Value: Facilitates real-time, synchronized collaboration and support, enhancing user experience and operational effectiveness.
Related Standards
IEC TR 63669:2026 maps its standardization focus to existing and emerging international frameworks, establishing continuity and synergy with:
By bridging gaps between established and emerging standards, IEC TR 63669:2026 aims to enable scalable, interoperable, and future-proof multimedia services that leverage the full spectrum of heterogeneous media data.
Keywords: heterogeneous media, multimedia data alignment, IEC TR 63669, 360° video, 3D audio, haptic data, sensor integration, media synchronization, multimedia standards, virtual reality, remote collaboration, media metadata, data interoperability.
