Name: Look What You MIDI Me Do!- レイチェル・ホワイト｜JSConf Hawaii 2020 (Look What You MIDI Me Do! - Rachel White | JSConf Hawaii 2020)
Uploaded: 2021-01-14T10:25:21.000Z
Duration: 19 min 36 s
Description: VoiceTubeの動画で発音を聞きながら英語表現を覚えよう！学べる英語：

So, um, my favorite type of programming is attempting things that I've never done before, which is an extra reason why I shouldn't be a fulltime software engineer.

Because I love the whole process of failing and learning from it, which I think is really important.

Especially admitting that in front of hundreds of people, Um, so as the artist residency, um, I did a series where, um, of artworks that were called New romance and I took Ah, play it.

Well, it was a play on Neuromancer by William Gibson, Obviously, but, um, the reason that I did this project was because I wanted to blend special effects makeup in technology together to better, um, visualize what modern cybernetic augmentation could look like.

And I did this in the sense that this is digitalized makeup.

And when I had the show to show people this, they were like, Well, that's really cool, but it's also weird, and I don't want to go near it, but they also didn't know how I did it.

So I got to talk to them about no bots, because this is just running on an Arduino, and it's a simple circuit that I started together.

And, um, the face is Angelina Fabbro if it's making you oddly like familiar with it, but you can't put a finger on it.

So weird Art and technology, stuff like that.

And so that leads me to what we're talking about today.

Um, I do visuals under the name M s paint.

Miss Page, Um, this was a show that I just played in January at a festival called Mag Fast.

It has 30,000 attendees and, like was, surprisingly, not as scary as top conferences.

Yeah, um, when I started doing visuals, I was using tools that other people had made already.

And I was like, Why not make this harder on myself and build my own tools?

So I do a lot of these trip tune shows, and I wanted something toe work for myself.

The thing that I had been working with before was called Lumen.

And excuse me, I was using this for a while.

What it is is it's an old school type of video synthesizer that has, like, patch board stuff that you packed around, and it was really cool, but, um It was very specific, and I'm gonna show you what it looks like.

So it has a bunch of these patches so that you can pick different kinds of emulation Sze of however they're altering the waves and you can change it in here and you could hook it up Thio a midi input and David And then you can get really wild back here.

I read the instructions a little bit, but I gave up because I was like this.

I got to do something myself great and then sear like, Why?

Um, so I already was doing visuals, so it seemed like a valid time and effort output to, you know, do it myself.

Like I said, I love trying things that I've never done before.

So, um, my process going through when I make things is probably similar to like how a lot of other people put things through.

I had an idea of how I wanted to control that input because I wanted to look cooler than just like standing up on stage with a laptop and pushing buttons.

I was like, I want to look even cooler This this is called a midi fighter.

There's a potential ometer inside There's buttons on the side and I was like, I was way cooler up onstage with one of these things in just a laptop.

So I have my buttons and I know I wanted to do something in the browser so that I could build that.

And then I was like, All right, so how am I gonna do this?

And, um, that I had figured out how to put them together the hard way?

Essentially, and that was, you know, learning a whole new A P I.

So maybe we all know about I'm to give you a little bit of a history of the protocol.

And so it's an acronym that stands for musical instrument digital interface, and it's a way to connect devices that make it, uh, making control sound.

So some people think that like when I talk about Mickey, I'm gonna be talking about the sound that gets out.

But we're just talking about the messages that communicate with it.

I'm so it's a protocol that allows Elektronik instruments and synthesizers to communicate, meaning a user control multiple electronic instruments from one synthesizer or a computer.

There used to be no coherent way for manufacturers to do this.

But then in 1981 at the Audio Engineering Society Convention in New York, Dave Smith proposed a rough version of a universal digital interface.

But he called the universal synthesizer into interface or us.

I, um, and he was like gonna go out and meet all these people and not that many people came.

So, you know, he was basically like, Here's my project and I want other people to contribute to it, And everybody was like, I'm not gonna do that.

Apparently, Um, except somebody that did show up was Qatar Okaka Hashi, who was the founder of Roland at the time.

And so the following year they displayed the fruits of their labor, and it was a demonstration on how many worked on how it was born, and then they want a technical Grammy for it in 2013 which is cool.

And yeah, So how does his MIDI work specifically?

And the most important thing to know about MIDI is that it is based on the idea of message passing between devices.

So, like pieces of equipment or software.

And so you have a keyboard and a synthesizer, and you would like to record a sequence using the sounds that are in the synthesizer.

And so you connect them so that they could communicate using that MIDI protocol and start record.

And when that happens, you play notes on the synthesizer, and all of the physical actions are transmitted as many messages to the computer sequencing software, which records the messages and so many messages or brief numeric descriptions of the action, which I'm gonna show you with the Web.

Nitti AP I When I push the buttons on the so that could be key presses, joystick wiggles, knob turns, they're all encoded and know you are interpreting what those messages mean.

So when you hear the sound that you're making, it's not because of theme idiots because of the messaging that the Midi is telling the synthesizer together.

Basically, the computer isn't making the earth.

Oh, So the concept of channels essential to how most meeting messaging works.

And that's an independent path over which messages travel to their destination.

Permit e device on a track on your sequence of program plays one instrument over a single channel when dealing with the musical application.

Maybe messages in their track find their way to the instrument that chill.

Like I said, we're not dealing with music today.

We're dealing with dignity, and the middIe tipple typically enable synthesizers, drum machines, you know, like the music stuff that we talked about.

But since it doesn't transmit audio, if you wanted to make a drum machine using the web giddy AP, I would just use audio attack simple so you could build your own drum machine if you like.

The other kind of thing that you can use it for is live event controls for lighting and special effects.

Really, it's like you can do whatever you want.

So the weatherman e a p I specs supports maybe protocol by allowing Web APS to enumerated select input and output devices on the client system and suddenly received many messages on.

But you're able to utilize non music applications as well as music ones by providing low level access to the media devices on the user systems and the women.

The AP I give you an output that tells you what kind of device is connected.

I'm gonna skip over it, use the audio tag if you're wanting to make music.

Um, basically, Web midi is really enabling a new class of application that can respond to Midian.

So, um, use it along with other AP eyes and from 43 up and you're ready to go.

Okay, Well, so I'm gonna show you some demos now of how it works.

Also ignore the deprecation messages in the console.

字幕リスト動画再生

Look What You MIDI Me Do!- レイチェル・ホワイト｜JSConf Hawaii 2020 (Look What You MIDI Me Do! - Rachel White | JSConf Hawaii 2020)

stuff

specific

essentially

potential