bytewax/awesome-public-real-time-datasets

A list of publicly available datasets with real-time data maintained by the team at bytewax.io

What it solves

Finding reliable real-time data sources is difficult. This list gathers them into one place, categorized by domain, with links and brief descriptions so developers can quickly locate a live feed for their streaming application.

How it works

The project is a simple curated README file on GitHub. It organizes entries under Free and Paid sections, then subcategories like Finance/Crypto, Transportation, Information, etc. Each entry includes the name, a link to the source, and a short description of what data it provides and how to access it (e.g., HTTP, WebSocket). The list is community-maintained and inspired by similar awesome lists.

Who it's for

Developers, data engineers, and researchers who need real-time or streaming data for prototyping, dashboards, analytics, or machine learning pipelines. It's also useful for anyone evaluating data sources for a project.

Highlights

  • Covers a wide range of domains: finance, transportation, weather, cybersecurity, sports, and more.
  • Most entries are free, with some paid options clearly marked.
  • Provides direct links to APIs, documentations, and endpoints.
  • Includes practical details like protocol (WebSocket, HTTP, SSE) and availability notes.

Related

  • Project
  • Project
  • Project
  • Project