A local AI song studio for 24 GB Macs: full songs from lyrics, melody-aware covers, six-stem separation, and an interactive ABC score. No cloud inference, no uploads to a server farm.
Lyrics + style → symbolic plan → 48 kHz song. 6-minute default, required blank title, Male default, summarize lyrics into memory, interactive ABC.
Reference audio → SheetSage2 melody → YuE2. 15–360s slider (default 360), required title, Beast Mode, influence controls, Interactive ABC.
Six local stems plus per-stem MIDI. Players, downloads, collapsible ABC, and the same score metadata.
Teach the studio after a song; Qdrant/Mem0 memories guide future Qwen, YuE and DeepSeek prompts. Local only.
CPU %, Apple GPU %, Ollama: Ready and MLX: Ready update every 3 seconds above both generators.
New melody and lyrics from an existing song's style/tempo, without copying its audio or melody.
| Component | Role | Runtime |
|---|---|---|
| YuE2-3B | Song/score generation, covers | MLX 8-bit via mlx-Yue |
| YuE2-Vae | 48 kHz decoder | MLX |
| SheetSage2 + MERT2 | Cover melody transcription | MLX |
| Qwen | Lyrics and style tags | Ollama |
| htdemucs_6s | Stem separation | ONNX Runtime CPU |
| abcjs + FluidR3_GM | Score engraving/playback | Browser |
Browser (React + Vite)
→ FastAPI 127.0.0.1:8000
→ mlx-Yue subprocess → Metal → YuE2-3B
→ Ollama (Qwen) for lyrics
→ demucs-onnx CPU for stems
→ ffmpeg for 48 kHz export
→ Qdrant + Mem0 for preferences/feedback
→ SQLite + SSE progress + interactive ABC score
git clone https://github.com/dcvizcayno/Music-Studio-Ver-0.1.git cd Music-Studio-Ver-0.1 # follow SETUP.md for the MLX weights and toolchain ./start.sh open http://127.0.0.1:8000
**Teach the studio** saves feedback to local Qdrant; **Summarize lyrics** saves an emotional/story summary. Both return as relevant context for future songs. Text to Song and Cover Studio show Song Title, Date Written, BPM and Key beside the Interactive ABC score.
A deterministic gate requires a 10-point score ≥ 8.00 with no hard blockers. Independent UI, sound-quality, and integration agents run real text/cover renders, stem checks, score rendering, and idle-disconnect recovery.