Hacker Trends: Visualizing 18 Years of Hacker News Discourse

Hacker Trends: Visualizing 18 Years of Hacker News Discourse

Hacker Trends provides a longitudinal analysis of technical discourse by indexing 18 years of Hacker News data, allowing users to visualize how specific tools, frameworks, and companies have trended over time. Built on Upstash Redis Search, the platform processes over 45 million posts and comments to generate live date-histograms of mentions.

Technical Architecture and Data Sourcing

Hacker Trends utilizes Upstash Redis Search to power its live date-histograms. The system indexes a massive dataset comprising 45 million entries from Hacker News, enabling users to overlay multiple search terms to compare the traction of different technologies side-by-side. Below each chart, the tool provides the original stories and comments associated with the data points, allowing users to move from high-level trends to specific discussions.

Community members have noted alternative ways to achieve similar results, with one user pointing to a publicly open database of Hacker News data hosted on ClickHouse that can be queried via SQL to create similar services.

Key Technical Trends and "Baton Passes"

The platform highlights several "changing of the guard" moments in the software industry, where one dominant technology is superseded by another in the community's conversation:

Frontend Frameworks and Build Tools

  • Frameworks: The discourse shifted from Angular (dominant ~2013–14) to Vue (2016–19), and subsequently to Svelte (2020–22).
  • Bundlers: Webpack dominated the build process from 2015–20, before being overtaken by Vite starting in 2022.
  • MVC Evolution: The early era was defined by Backbone.js (~2011), followed by Ember and Angular (2013–14), which set the stage for React's eventual dominance.

Backend and Infrastructure

  • Databases: MySQL led the conversation around 2009–11, but Postgres climbed to overtake it by 2017–20.
  • Containers: Docker saw a massive eruption in 2014–15, while Kubernetes took the spotlight from 2016 onward as orchestration became the primary focus.
  • CI/CD: Jenkins was the primary tool of the mid-2010s, with GitHub Actions taking over from 2021.

AI and Machine Learning

  • ML Frameworks: TensorFlow drove the initial deep-learning surge (2015–16), followed by PyTorch (2019–21), and more recently JAX (2021–23).
  • LLM Evolution: The generative AI era is marked by the launch of ChatGPT in late 2022, followed by the emergence of open-weight models like Llama (early 2023) and Mistral (late 2023). More recent spikes include DeepSeek in January 2025.

Languages and Runtimes

  • JVM/Mobile: A relay occurred between Scala (~2011), Swift (mid-decade), and Kotlin (as Android moved to Kotlin-first).
  • Node Alternatives: Deno was the primary point of interest from 2020–22, while Bun has dominated the spotlight from 2023 onward.

Community Insights and Critique

While the tool has been praised for its conceptual value, users have raised several technical and analytical points:

  • Search vs. Mention: One user clarified that unlike Google Trends, which tracks search intent, Hacker Trends tracks published text. This means it reflects what people are writing about rather than what they are searching for, which may exclude non-newsworthy but frequently searched terms.
  • Normalization: Users suggested that the tool should normalize data by total site volume to distinguish between a genuine increase in a topic's popularity and general growth in the number of Hacker News users.
  • Noise and Filtering: Some users observed missing data for common terms like "Java" or "Go," suggesting that common words might be filtered out or that the indexing strategy may struggle with terms that have dual meanings (e.g., "go" as a verb vs. "Go" as a language).
  • Sentiment Analysis: There is community interest in adding sentiment analysis to the trends, allowing users to differentiate between positive and negative mentions of a specific company or tool.

"Google Trends is about searches. This is about published text... People don't write much about non-newsworthy things whereas many people search 'burger' anytime they want a burger delivery."

Notable Industry "Shockwaves"

The data reveals specific moments of industry-wide volatility:

  • The Unity Crisis: In September 2023, a simultaneous spike in mentions of Unity, Unreal, and Godot occurred following the Unity runtime-fee controversy, as developers sought alternatives.
  • The Twitter Exodus: The 2022 acquisition of Twitter led to a spike in Mastodon mentions, which was later overtaken by Bluesky in 2024–25.
  • Hardware Shifts: The conversation around CPUs shifted from x86 dominance (2020–23) to an ARM surge (2024–26), driven by Apple Silicon and data-center ARM adoption.

Sources