Local-first · Apple Silicon · MLX

Song Studio
write it. hear it. split it.

A local AI song studio for 24 GB Macs: full songs from lyrics, melody-aware covers, six-stem separation, and an interactive ABC score. No cloud inference, no uploads to a server farm.

View GitHub → Setup guide
YuE2-3BMLX 8-bitSheetSage2 Qwen / Ollamahtdemucs_6sabcjs FastAPIReact 19

What it does

Text to Song

Lyrics + style → symbolic plan → 48 kHz song. 6-minute default, required blank title, Male default, summarize lyrics into memory, interactive ABC.

Cover Studio

Reference audio → SheetSage2 melody → YuE2. 15–360s slider (default 360), required title, Beast Mode, influence controls, Interactive ABC.

Library stems + MIDI

Six local stems plus per-stem MIDI. Players, downloads, collapsible ABC, and the same score metadata.

Memory + feedback

Teach the studio after a song; Qdrant/Mem0 memories guide future Qwen, YuE and DeepSeek prompts. Local only.

Live resources

CPU %, Apple GPU %, Ollama: Ready and MLX: Ready update every 3 seconds above both generators.

Use as Inspiration

New melody and lyrics from an existing song's style/tempo, without copying its audio or melody.

Models and runtime

ComponentRoleRuntime
YuE2-3BSong/score generation, coversMLX 8-bit via mlx-Yue
YuE2-Vae48 kHz decoderMLX
SheetSage2 + MERT2Cover melody transcriptionMLX
QwenLyrics and style tagsOllama
htdemucs_6sStem separationONNX Runtime CPU
abcjs + FluidR3_GMScore engraving/playbackBrowser

How it runs

Browser (React + Vite)
  → FastAPI 127.0.0.1:8000
      → mlx-Yue subprocess → Metal → YuE2-3B
      → Ollama (Qwen) for lyrics
      → demucs-onnx CPU for stems
      → ffmpeg for 48 kHz export
      → Qdrant + Mem0 for preferences/feedback
  → SQLite + SSE progress + interactive ABC score
This Hugging Face Space is a project page only. The app runs locally on your Mac; there is no hosted inference or audio upload here.

Quick start

git clone https://github.com/dcvizcayno/Music-Studio-Ver-0.1.git
cd Music-Studio-Ver-0.1
# follow SETUP.md for the MLX weights and toolchain
./start.sh
open http://127.0.0.1:8000

Memory + metadata

**Teach the studio** saves feedback to local Qdrant; **Summarize lyrics** saves an emotional/story summary. Both return as relevant context for future songs. Text to Song and Cover Studio show Song Title, Date Written, BPM and Key beside the Interactive ABC score.

Quality gates

A deterministic gate requires a 10-point score ≥ 8.00 with no hard blockers. Independent UI, sound-quality, and integration agents run real text/cover renders, stem checks, score rendering, and idle-disconnect recovery.