whitphx/streamlit-webrtc

Real-time video and audio processing on Streamlit

What it solves

streamlit-webrtc is a component for Streamlit that enables the handling and transmission of real-time video and audio streams over a network. It allows developers to integrate live media streams into their web applications without needing to build a complex WebRTC infrastructure from scratch.

How it works

The library provides a webrtc_streamer widget that manages the WebRTC session. Developers can define callback functions—video_frame_callback and audio_frame_callback—to process media frames in real-time. These callbacks receive and return frames as PyAV objects (av.VideoFrame or av.AudioFrame), allowing for the injection of image or audio processing logic (such as OpenCV filters or AI models) directly into the stream.

Who it’s for

It is designed for Python developers using Streamlit who want to build real-time media applications, such as video chat apps, real-time speech-to-text tools, or computer vision applications.

Highlights

  • Real-time Processing: Supports both video and audio frame callbacks for live manipulation.
  • AI Integration: Easily integrates with libraries like OpenCV and MediaPipe for tasks like object detection and pose estimation.
  • Flexible Controls: Includes built-in media toggle buttons for camera and microphone access.
  • Deployment Ready: Provides guidance and configuration options for HTTPS, STUN, and TURN servers to ensure connectivity across different network environments.

Related

  • Project
    streamlit/streamlit

    A Python framework that transforms scripts into interactive web apps, enabling data scientists to build and share dashboards and AI chat apps without front-end experience.

  • Project
    livekit/python-sdks

    LiveKit’s Python SDK provides two packages (`livekit` for real‑time media participation and `livekit-api` for server‑side token and room management). It enables Python apps to join LiveKit video/audio rooms, publish/consume media, run RPC between participants, and integrate with LiveKit’s voice‑AI Agents (STT, LLM, TTS). Install via pip, generate a JWT token, connect to a room, and use the `MediaDevices` helper for microphone/speaker handling. The SDK is async, works with Python 3.9+, and is MIT‑licensed.

  • Dispatch
    FastRTC: The Real-Time Communication Library for Python

    Hugging Face has released FastRTC, a Python library designed to simplify the development of real-time audio and video AI applications by handling the WebRTC and WebSocket communication layers.

  • Project
    aparsoft/yolo-streamlit-detection-tracking

    YOLO Vision Studio is a Streamlit web app that runs Ultralytics YOLO models for detection, segmentation, pose estimation, text‑prompted object search, and multi‑object tracking. It shows live counts of objects in the current frame and unique IDs seen so far, with a churn metric to gauge tracking quality. Supports webcam, RTSP, YouTube, and local video sources, and offers four built‑in trackers with optional appearance ReID. Install via `uv sync` (or pip), run `streamlit run app.py`, and start analyzing videos instantly.

  • Dispatch
    Hosting Models and Datasets on Hugging Face Spaces using Streamlit

    Hugging Face Spaces integrates with Streamlit to allow users to quickly build and host interactive demos for machine learning models and data visualizations.