ptnghia-j/ChordMiniApp
Music Analysis, Chord Recognition, Beat Tracking, Guitar Diagrams, Piano Visualizer, Lyrics Transcription Application, context-aware LLM inference for analysis from uploaded audio and YouTube video
What it solves
ChordMini 是一款开源的音乐分析工具,旨在自动化从音频中提取音乐结构的过程。它解决了手动从歌曲中抄写和弦、节拍和旋律的困难,为音乐人和学习者提供吉他图表与钢琴卷帘等视觉辅助。
How it works
该应用使用机器学习模型和外部 API 相结合来分析音频文件或 YouTube 视频。它采用 Python 后端运行节拍检测(via Madmom and Beat-Transformer)和和弦识别(via Chord-CNN-LSTM and BTC variants)。为了提供高级功能,它集成了 Google Gemini API 进行罗马数字分析和歌词翻译,并使用 SongFormer 进行歌曲分段。实验性的旋律转写由独立的 Sheet Sage 服务处理。
Who it’s for
它面向音乐人、音乐学生和制作人,帮助他们快速获取和弦进行、节拍跟踪以及演奏时的可视化指南。
Highlights
- Comprehensive Analysis: Performs chord recognition, beat tracking, and song segmentation (intro, verse, chorus, etc.).
- Interactive Visualizers: Includes a real-time piano roll with MIDI export and interactive guitar chord diagrams.
- AI-Assisted Lead Sheets: Combines synchronized lyrics with a Gemini-powered chatbot for contextual music analysis.
- Multi-Source Input: Supports direct audio uploads and YouTube URL integration.
- Experimental Melody Transcription: Can estimate melodic lines and render them as sheet music.