rin.kagamine 1e21b7dcc8 feat: BPM and musical key detection for all clips
Backend:
- New analysis.py module using librosa for BPM + key detection
  - detect_bpm(): librosa.beat.beat_track() returns tempo
  - detect_key(): Krumhansl-Schmuckler key profiles on chroma features
  - analyze_clip(): combined call returning {bpm, key}
- New dependency: librosa==0.10.2 + soundfile==0.12.1
- Database migrations: bpm (REAL) and key (TEXT) columns added
- New set_analysis() function in database.py
- New endpoint: GET /api/clips/{id}/analysis
  - Returns cached analysis if available
  - Computes on-demand if missing, caches result
  - 400 if clip not ready, 404 if no audio file

Frontend:
- Clip interface extended with bpm?: number | null, key?: string | null
- Gallery: BPM and key badges shown in ribbon and tile views
  - BPM badge: lyria-accent background
  - Key badge: white/5 background
- DetailPanel: BPM and key shown in metadata grid when available
- App.tsx: handleSelectClip() fetches analysis on-demand when opening
  detail panel if not already cached

Docs:
- Architecture KB updated with Audio Analysis section
- Tasks KB: T-028 marked In Progress → will mark Done after commit
2026-05-29 21:09:04 -04:00

Lyria Studio

A webapp for generating, playing, and storing music clips using Google's Lyria music generation models.

Built by Kagamine Rin & Ryan.

Quick Start

# Backend
cd backend
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
cd src
uvicorn main:app --reload

# Frontend (new terminal)
cd frontend
npm install
npm run dev

Architecture

  • Backend: FastAPI (Python) — async Lyria API client, SQLite metadata, file storage
  • Frontend: React + Vite + TypeScript + Tailwind — dark theme, audio player
  • Storage: SQLite for clip metadata, local filesystem for MP3 files

API

Endpoint Method Description
/api/health GET Health check
/api/generate POST Start clip generation
/api/clips GET List all clips
/api/clips/{id} GET Get clip metadata
/api/clips/{id}/audio GET Stream MP3
/api/clips/{id} DELETE Delete clip

Models

  • v0.1: Lyria 3 Clip Preview (30s, REST)
  • v0.2: Lyria 3 Pro (structure-aware, ~3min)
  • v0.3: Lyria RealTime (WebSocket streaming)

License

MIT — Hardcore will never die.

S
Description
A webapp for generating, playing, and storing music clips using Google's Lyria models
Readme MIT
1.7 MiB
0 Stars 2 Watchers 0 Forks
Languages
TypeScript 51.8%
Python 47.4%
JavaScript 0.3%
Dockerfile 0.2%
CSS 0.2%
Other 0.1%