dw-dengwei/daily-arXiv-ai-enhanced

Automatically crawl arXiv papers daily and summarize them using AI. Illustrating them using GitHub Pages.

📚 What daily‑arXiv‑ai‑enhanced does

This repository provides a no‑server, GitHub‑only service that each day:

  1. Crawls the arXiv API for new papers in a set of computer‑science categories (default: CV, GR, CL, AI, CE, GT, IT, LG).
  2. Sends the abstracts (or full text) to a large language model – the default is deepseek‑chat – which returns a short Chinese‑language summary.
  3. Publishes the results as a static website hosted on GitHub Pages, so anyone can browse the daily digest without installing anything.

The project is essentially a pipeline that stitches together three pieces of existing technology:

  • arXiv’s public RSS/JSON feed for paper metadata,
  • an LLM API (DeepSeek, but any OpenAI‑compatible endpoint works), and
  • GitHub Actions + Pages for scheduling and hosting.

Because the whole workflow runs in GitHub’s CI environment, you pay only the LLM usage cost (≈ 0.2 CNY per day) and nothing for servers or storage.


✨ Core features (as described in the README)

Feature What it means for a user
Zero infrastructure No VM, Docker, or cloud account needed – just fork the repo and enable GitHub Actions & Pages.
AI‑powered summarization Daily papers are summarized by DeepSeek (or any model you configure) and the output is in Chinese by default.
Personalised reading You can store a list of keywords/authors locally; the UI highlights papers that match your interests.
Cross‑device UI The generated site works on desktop and mobile browsers.
SKILL system A plug‑in style mechanism that lets you add custom “skill” modules to filter or transform the paper list.
Exportable preferences One‑click copy of your keyword/author settings so you can share or reuse them with the SKILL system.
Customisable By editing repository secrets/variables you can change categories, target language, LLM model, and even protect the site with a password.

🛠️ How to get it running (quick‑start)

  1. Fork the repo.
  2. Add two secrets: OPENAI_API_KEY (your LLM key) and OPENAI_BASE_URL (the endpoint, e.g., DeepSeek’s API URL).
  3. (Optional) Set secrets.ACCESS_PASSWORD to restrict public access.
  4. Add variables for:
    • CATEGORIES – comma‑separated arXiv categories you care about.
    • LANGUAGE – Chinese or English.
    • MODEL_NAME – e.g., deepseek-chat.
    • EMAIL / NAME – used by the workflow to commit the generated site.
  5. Enable GitHub Actions and run the workflow arXiv-daily-ai-enhanced once (it may take ~1 hour). Subsequent runs are scheduled daily.
  6. Turn on GitHub Pages (source: main branch, root) and wait a few minutes. Your site will be reachable at https://<your‑username>.github.io/daily-arXiv-ai-enhanced/.
  7. Browse the site, adjust your keyword preferences in the Settings panel, and enjoy daily AI‑summarised arXiv digests.

🎯 Who might find this useful?

  • Researchers who want a quick, language‑specific skim of new papers without reading every abstract.
  • Students looking for daily exposure to cutting‑edge CS research in a language they’re comfortable with.
  • Anyone who prefers a static‑site, privacy‑preserving way to get AI‑generated summaries rather than running a self‑hosted server.

📦 What’s inside the repo?

  • .github/workflows/run.yml – the scheduled Action that fetches arXiv data, calls the LLM, and writes markdown files.
  • src/ (implicit) – scripts that handle API calls, prompt construction, and result formatting.
  • buy-me-a-coffee/ – a small placeholder for a donation page.
  • README.md – the documentation you’re reading now.
  • Static assets (HTML/CSS/JS) that render the final site with filtering, highlighting, and preference export.

⚠️ Legal / compliance note

The README warns users in jurisdictions with academic‑data censorship to review the content and possibly remove the China‑accessible entry point. Redistribution must respect both the original papers’ licenses and any AI‑generated content regulations.


In a nutshell: daily‑arXiv‑ai‑enhanced is a lightweight, GitHub‑only service that automatically pulls new arXiv papers, summarizes them with an LLM, and publishes a tidy, searchable daily digest – all without you needing to manage servers or pay for hosting.

Related

  • Project
  • Project
  • Project
  • Project
  • Project