An experiment with Google’s Magenta RealTime 2
Piano
to flute.
The same piano input.
Flute from the edited model.
0.032% of the model’s weights changed.
A permanent edit, calculated without backpropagation.
Inspired by Sparks of Weight-Space Programming.
Main edit by GPT-6 Astra, using Python and piano/flute examples.
Prompt sent to the model
A solo honky-tonk piano plays a fast boogie-woogie, only piano.
Original and edited models get this exact prompt. Only the saved weights change.
Heard in this outputPiano
Generation details
These are saved model outputs. Playback restarts when you switch. Audio levels are matched for comparison; each waveform is scaled to its clip’s peak.
Inside the
edited matrix.
This adapter maps text or audio style into the generator. Compare its original weights, edited weights, and the change.
Hover to inspect. Tap or use arrow keys.
Selected block
Rows 0–15 · Columns 0–15Select a block to inspect its values.
- 1
Encode the examples
The frozen encoder turns piano, flute and control examples into style vectors.
- 2
Calculate the update
A linear solve sets where to apply the piano-to-flute shift, using the controls as constraints.
- 3
Save the matrix
The edited checkpoint loads in the original runtime. No extra prompt or activation hook.
Try the
3.15 MB patch.
Replace the style adapter in the pinned Magenta checkpoint, then generate locally.
These are selected examples. Audio references guide the style; the model generates new music.
The player uses recorded outputs. Run the model locally to generate your own.