qingmeng1/bilijump-ai

Bilibili AI Skip – Chrome/Firefox extension

What it does

• Detects and skips inserted advertisements in Bilibili videos automatically, using AI to analyse either the video subtitles or the audio track.
• Offers a manual‑skip mode for users who prefer to confirm each jump.

How it works

1. Subtitle‑first detection – The extension reads the on‑screen subtitles (if present) and runs a prompt‑based AI model to decide whether a segment is an ad.
2. Audio fallback – When subtitles are missing, the audio is uploaded to Alibaba Cloud’s paraformer speech‑to‑text service (free 10 h/month, then ¥0.288/h). The transcribed text is then fed to the same AI model.
3. Cloudflare cache – Detected ad timestamps are stored via a Cloudflare API so the same video does not need to be re‑analysed on subsequent views.
4. User correction – Viewers can adjust or add ad intervals, feeding the corrections back into the shared database.

Key features

• Automatic skip – When enabled, the player jumps over the ad segment without user interaction.
• Manual skip UI – If auto‑skip is off, a pop‑up appears during an ad with a “Skip” button and a countdown.
• API configurability – Users supply their own AI endpoint (e.g., Gemini, Grok, GPT‑4.1) and Aliyun credentials; the extension also ships with a free, author‑maintained API option.
• Surge module – An optional surge script (bilijump.sgmodule) lets users skip OP/ED sections of anime via a MitM proxy.
• Usage tracking – The extension tracks how much of the Aliyun paraformer quota has been consumed per API key and month, automatically falling back from v2 to v1 models when the quota runs out.
• UP/Tag filters – Users can blacklist specific creators or tags so those videos are never analysed.
• Cross‑browser – Available on Chrome Web Store and Firefox Add‑ons; compatible with Manifest V3 browsers (including Arc).

Setup steps

1. Install the extension from the Chrome Web Store or Firefox Add‑ons page.
2. Open the settings panel and:
   • Enable the extension.
   • Turn on Automatic skip (optional).
   • Enter your AI API key/URL and, if you want audio analysis, your Alibaba Cloud AccessKey/Secret.
3. For videos without subtitles, the extension will prompt you to start audio analysis; you can choose to do it manually to avoid spending free quota.
4. When an ad is detected, the UI shows a status bubble (“AI analyzing…”, “Ad skipped”, etc.). Use the “Correct” button on the player toolbar to adjust any mis‑detected intervals.

Technical details

• AI model – The extension sends the subtitle or transcribed text to a configurable LLM (recommended Gemini‑2.5‑flash, Grok, or GPT‑4.1) which returns start/end timestamps and a brief description.
• Audio transcription – Calls Alibaba Cloud’s paraformer‑v2 (or v1 as fallback) via the user‑provided credentials.
• Data storage – Uses a Cloudflare Workers API to cache ad timestamps; the cache is shared among all users of the extension.
• Front‑end – Settings page built with plain HTML/CSS; in‑video pop‑ups are injected via content scripts and styled dynamically.
• Permissions – Requires host permissions for *.bilibili.com, the configured AI endpoint, and the Cloudflare API; also needs audioCapture when performing audio analysis.

Licensing

• Distributed under the MIT License.

---

Bottom line – Bilibili AI Skip is a practical, user‑controlled tool that leverages LLM‑driven text analysis (and optional speech‑to‑text) to identify and bypass ad segments on Bilibili, with community‑editable data and support for both automatic and manual operation.