Pilot for Ableton

With deployment to more DAW's later.

Pilot is an AI agent that runs beside Ableton Live 12. It watches the producer’s screen, understands natural language instructions, and performs precise actions (MIDI editing, synth parameter changes, drum pattern generation, arrangement help) while keeping the user fully in control. It solves the biggest frustration for electronic music producers: spending hours on tedious technical tasks instead of making music. Early demos show 5-10x faster iteration on MIDI fixes and sound design.

Explore Source Code

"Most common use case is stem separation (73.9%) & EQ/Mastering tools (45.5%) while only 3% of music producers use generative AI for creating full songs. In general, music producers are in favor of assistive AI and against generative AI. Respondents not using AI say creative control is the reason for not using AI (82.2%)."

— Tracklib. (2024). AI & music: Tracklib music producer survey 2024.

Their 2025 survey repeated the same sentiment.

🌟 Featured Intelligence 🚀 Capabilities Gallery

Products shown are still in development and are not representative of the final product.

Autonomous Logic

MIDI Correction & Logic

"The midi notes in the midi clip in track 2 are not in the correct positions to match where the drum kit instruments are"

Claude analyzes the track layout, identifies pitch mismatch, and calculates transposition for atomic injection. NOTE: The music on the video is background music recorded by the mic. Actual audio from Ableton is later in the video.

  • Vision Identified the "Kick" row in the MIDI editor.
  • Logic Calculated pitch transposition manually.
  • Action Used OSC for atomic note injection.
AI Reasoning Log
Loading original log file...
UI Interaction

Sound Design Iteration

"Add a synth and set its controls to produce a classic progressive house soft synth sound that is often laid over female vocals"

Navigating Analog's parameters via Accessibility (AX) and processing natural language feedback to soften the sound.

  • Feedback Processed "too harsh" user input.
  • Navigation Manipulated filter and envelope knobs.
  • Precision Used AX set_value for exact positioning.
AI Reasoning Log
Loading original log file...
Final creative music piece based on basis for track provided by agent.
Production

Generative Drum Rhythms

"Add a drum track with some random rhythm in it"

Demonstrating the ability to generate complex, non-deterministic musical patterns through high-level intent.

  • Architecture Orchestrator plans the "vibe" and rhythm.
  • Execution Driver executes the precise clip creation.
  • Verification Vision confirms the drum kit is loaded.
AI Reasoning Log
Loading original log file...
Workflow

Precision Clip Orchestration

"Create a new midi clip in track 1"

Reliable multi-step workflow handling browser navigation, track selection, and clip creation. NOTE: The music on the video is background music recorded by the mic.

  • Browser Navigates the Ableton side-bar library.
  • Timing Manages turn-based handshake for UI state.
  • Reliability Robust double-click logic for creation.
Final creative music piece based on basis for track provided by agent.
Architecture

Arrangement Workflow

"Make a basic techno track"

A full-scale demonstration of the orchestrator/driver architecture building a foundation from scratch. The video is creative playback of the piece created by the agent. I added a distort filter.

  • Hierarchy Orchestrator handles track arrangement.
  • Bridge Real-time OSC status updates.
  • Scale Managing multiple tracks and instruments.
AI Reasoning Log
Loading original log file...
Music Theory

909 Swing & Grooves

"Create a 909 based drum rhythm with swing on the hihat"

Applying complex swing and humanization to high-hat patterns using generative logic.

  • Theory Understanding swing percentages.
  • Timing Offsetting MIDI note start times.
  • Result Professional 909 "groove" foundation.
AI Reasoning Log
Loading original log file...