Skip to main content
Back to Portfolio
HackNotts 2025 • Multi-Agent GenAI

lyricforge

An AI-powered multi-agent pipeline for thematic lyric rewriting and text-to-speech synthesis built during a 24-hour hackathon sprint.

Multi-Agent AI Pipeline & Latency Optimization

Coordinated a multi-agent backend using Python and Flask to orchestrate semantic song understanding, vocal isolation, and ElevenLabs text-to-speech generation—minimizing pipeline latency while strictly preserving rhyme schemes, syllabic cadence, and emotional tone.

Core Capabilities

  • Multi-Agent AI Pipeline

    Coordinating LLM agents in Python/Flask to decouple semantic decomposition from poetic rewriting.

  • Context-Aware Audio Synthesis

    ElevenLabs API orchestration with custom voice timbre and emotion-conditioned speech synthesis.

  • Syllabic Meter & Rhyme Preservation

    Algorithmic validation enforcing syllable count matching and rhythm cadence against original song tracks.

  • Low-Latency Concurrency

    Asynchronous stream dispatch minimizing perceived waiting time during complex multi-step generation.

Technology Stack

Backend LayerPython 3.x, Flask, Async Dispatch
LLM OrchestrationGoogle Gemini API (Multi-Agent Prompts)
Audio SynthesisElevenLabs API (TTS Voice Cloning)
Client InterfaceTypeScript, React, HTML5 Audio
EventHackNotts 2025 (24-Hour Crucible)

HackNotts 2025 Crucible

LyricForge was developed during HackNotts 2025 in an intense 24-hour sprint. The ambition was to build an intelligent creative studio that could take any existing musical track and rewrite its lyrics to match an entirely new theme or emotion—all while retaining the track's original syllabic structure, rhythm, and rhyme scheme.

Multi-Agent Pipeline Architecture

A naive single-prompt approach fails because LLMs struggle to balance lyrical creativity with rigid meter constraints simultaneously. To solve this:

  • Analyzer Agent: Breaks input lyrics into verses, measuring syllable counts, stress patterns, and rhyme schemes (e.g. AABB, ABAB).
  • Thematic Composer Agent: Rewrites lines according to target moods while respecting the extracted rhythmic skeleton.
  • Synthesis Agent: Dispatches rewritten lyrics to ElevenLabs API to generate emotionally nuanced vocal output with minimal latency.
Explore More Case Studies
Previous Project

Event Ticket Booking System

Java • Swing (GUI) • OOP Design

Next Project

Embedded Payroll System

C/C++ • Arduino Uno • UART Protocol

All Projects Grid