Notes for class meeting of April 3rd 2006
Where next for MEAPsoft?
What about a GUI (for accessibility)?
- visual programming for hooking things up
- presets for interesting processes
- make it like Max... ?
- just 4 drop-down lists to choose arguments for each stage
- maybe just focus on mashup composer
Write it how? Some interface builder for JAVA
- nothing as nice as MS's visual interface
- they are coming along
- build as components for Max
New components
- pitch-based feature extractor (Graham's melody extractor)
- or pitch + timbre e.g. linear cepstra out to high quefrency
- something to recover/preserve/introduce high-level structure ("form")
- e.g. parse songs into sections, add section as a particular feature
- anchor-space style features e.g. drumness, guitarness
- frame-level classifiers plus summarize-into-segment operator
How to release it live?
- Kiosk - but has to be live
- Web site - just run the code on user's machines
- works better for faster-than-real-time
- telephone interface - beatbox in, listen back
MEAP Mashup night?
- let people loose and see what happens
- live mic input - let people make noises and have fun
- duels?
- or drive it with an actual conversation - pacing, pitches, pauses
- or auto sound track to movies
Short-term plan:
- provide pitch features (Graham)
- create some kind of gui (to make it easier to play with)
- try to release it on the web?
And now for something completely different:
The Random Sampling Synthesizer
- play a MIDI keyboard, chooses an pitch- or chord-matched sample at random
- with some inertia in general sample similarity
(buy apple's recommendation: 61 note keyboard )
- just a regular sampling synth, but samples for each key are inserted at random
- second thread substitutes samples on the fly - based on your playing style?
- allow samples to be written in from playing in an iPod live
- how much keyboard skill do you need?
- make it only partially respond to keyboard - ignore out-of-key notes, quantize time
- have preset MIDI stream inputs
- audio-to-midi melody transcription - needed for preprocessing database - also means you can drive the random synth from audio intput instead of a keyboard
- LED metronome to encourage tempo that matches database
- "trading 4s"/simon interface
- you play in a phrase, computer plays back its version
- maybe computer adds a few notes at the end.. etc.
- include rhythm analysis as well as melody
- arpeggiation response when people hold down a chord - 3 different samples
- i.e. drum machine interface instead of keyboard - drum sounds selected from different sounds
- drum machine next to keyboard - actual real regular drum machine
- meapsoft + eigenrhythms!
- build the whole thing into a car with a steering wheel and a telephone (car phone) interface
- call your friends to play them your latest mix
- call LabROSA to play in the latest mix and have it be meapmashed back to you