google/spatial-media

Specifications and tools for 360º video and spatial audio.

What it solves

It provides a standardized way to handle 360-degree video and spatial audio, ensuring that media files can be correctly identified and played back as immersive experiences rather than flat images.

How it works

The project consists of a set of metadata specifications (RFCs) for spatial audio, spherical video, and VR180 video formats. It also includes a set of tools to inject this required metadata into media files so that players and platforms can recognize the spatial nature of thecontent.

Who it’s for

Content creators and developers working with immersive media, such as VR/AR developers and 360-degree video producers.

Highlights

  • Metadata specifications for spatial audio and spherical video (including V2).
  • Support for the VR180 video format.
  • Tools for injecting spatial metadata directly into media files.

Related

  • Project
    stereolabs/zed-sdk

    A cross-platform spatial perception SDK for ZED cameras that provides real-time depth sensing, object detection, and positional tracking.

  • Project
    VisionDepth/VisionDepth3D

    VisionDepth 3D is a Windows desktop app that converts 2‑D images or videos into stereoscopic 3‑D using AI depth models, depth‑map blending, RIFE frame‑interpolation, and AI super‑resolution. It offers a free tier (limited length, 1080p, watermarked) and a one‑time $59.99 Pro tier (no limits, 4K+, batch processing, advanced controls). Installation is via an Itch.io “Setup Hub” that provides CUDA (NVIDIA) or DirectML (AMD/Intel) builds. The software is proprietary, but the AI models it downloads are open‑source under their own licenses.

  • Project
    realsenseai/librealsense

    A cross-platform SDK for RealSense depth cameras that enables depth and color streaming and provides calibration data for computer vision and robotics.

  • Project
    facebookresearch/vrs

    A high-performance file format and library for recording and playing back synchronized, time-stamped streams of multimodal sensor data from devices like AR/VR headsets.

  • Project
    Visionary-Laboratory/holi-spatial

    A data curation pipeline that transforms video streams into annotated 3D spatial intelligence datasets, including 3D Gaussian Splatting geometry and spatial QA pairs.