ptnghia-j/ChordMiniApp

Music Analysis, Chord Recognition, Beat Tracking, Guitar Diagrams, Piano Visualizer, Lyrics Transcription Application, context-aware LLM inference for analysis from uploaded audio and YouTube video

What it solves

ChordMini 是一款开源的音乐分析工具,旨在自动化从音频中提取音乐结构的过程。它解决了手动从歌曲中抄写和弦、节拍和旋律的困难,为音乐人和学习者提供吉他图表与钢琴卷帘等视觉辅助。

How it works

该应用使用机器学习模型和外部 API 相结合来分析音频文件或 YouTube 视频。它采用 Python 后端运行节拍检测(via Madmom and Beat-Transformer)和和弦识别(via Chord-CNN-LSTM and BTC variants)。为了提供高级功能,它集成了 Google Gemini API 进行罗马数字分析和歌词翻译,并使用 SongFormer 进行歌曲分段。实验性的旋律转写由独立的 Sheet Sage 服务处理。

Who it’s for

它面向音乐人、音乐学生和制作人,帮助他们快速获取和弦进行、节拍跟踪以及演奏时的可视化指南。

Highlights

  • Comprehensive Analysis: Performs chord recognition, beat tracking, and song segmentation (intro, verse, chorus, etc.).
  • Interactive Visualizers: Includes a real-time piano roll with MIDI export and interactive guitar chord diagrams.
  • AI-Assisted Lead Sheets: Combines synchronized lyrics with a Gemini-powered chatbot for contextual music analysis.
  • Multi-Source Input: Supports direct audio uploads and YouTube URL integration.
  • Experimental Melody Transcription: Can estimate melodic lines and render them as sheet music.