Generative Music | Latent Space Sequencer
Last week after class I tried training a performanceRNN model with my Yoko Shimomura with more steps (>30,000), but it didn’t give me a good generation without perpetually-sustained notes.
Because of that failure and the past performances, for this final performance I want to create something that moves beyond generating musical phrases similar to my dataset. I decided to use MusicVAE.js to create music from latent spaces.
The final code is a combination of Torin Blankensmith’s Melody Mixer (blog post, repo) and Tero’s Latent Cycles – honestly it’s just a much simpler version of Latent Cycles.
I used Torin’s code for one of his Melody Mixer demos as a base, and I wrote my own Tone.JS code so that I can play the interpolated note sequences in a way that I wanted. Basically each note sequence behaves like a toggle-able loop, and the second row plays 2x as slow as the first row.
The 2 source melodies are the default melodies provided in Torin's code.
I think it’s interesting to emulate Steve Reich / Brian Eno with the latent space sequencer, because the adjacent tiles are similar to each other and playing them at different speed / start time creates interesting sound texture.
Find full code here: https://github.com/hafiyyandi/hafiyyandi.github.io/tree/master/latent_space_sequencer
Related Posts
See AllBias in Youtube Recommendation / Flagging Algorithm Social platforms like Facebook, Instagram, Youtube, and Twitter host and distribute...
