And welcome to a video slash tutorial on I'm just gonna be poking around the Carla Library thing.

If you're not familiar with Karl, I don't imagine many of you guys are.

It's an open source simulator for autonomous driving research.

OK, so basically what it does is creates a simulated environment specifically dedicated toward people who want to train self driving cars.

Eso Historically, I've always used Grand Theft Auto for my shenanigans, but this has certain benefits over that because it's just basically built from the ground up to have an A p I for you to do all kinds of automated trial and error kind of stuff and so just kind of makes sense.

The last time I looked into it was like two years ago, Um and I don't think I even got off the ground with it.

I forget exactly the issue.

I think I could run the simulation but not connect to it or something.

It was some sort of strange thing going on there, so I thought I would take another look into this, uh, kind of package here and then share with you guys the steps that I take whenever I'm visiting some new library.

I pretty much like I understand what Carla is, but I've really never worked with it.

Because, like I said, I couldn't even get the basic thing toe like run.

So I'm gonna try that again.

If it works, you'll see this video.

If it doesn't work, you won't know about this.

Video eyes ever seeing it?

Hey, Aurich.

Uh, okay, so I land on Carla.

Okay, The first thing I want to do is just go to get started already.

Kind of know what Carla does.

Um, it might be useful to read this, though.

Like here.

You can see that you can, um, have, like, a server with multiple clients that connects so you can run multiple agents at any given time.

Um, the other thing that I noticed was basically, there's, like, remote connection now, which is pretty cool.

Ah, you can disable rendering of the simulation, which I guess both for client and server would be quicker so you could run things quicker.

You don't necessarily have to run in real time, so Okay.

Pretty cool.

Um, I don't know anything about I've never used the robot operating system but But that's pretty cool, too.

They have some sort of bridge.

They're like, That's kind of interesting that, you know, you could even test that kind of stuff.

So if you wanted to use that with self driving cars, that's pretty cool, too.

So, um, they also apparently have some autonomous driving baselines.

That's also interesting.

I might want to check those out just to see how they do a couple of things, because you want.

You definitely want things to be as efficient and clean as possible.

So I'll be looking into that.

Obviously, for me, I'd like to do self driving eso I kind of want to poke around and play with, um, all the stuff that they have here, Uh, and then they also have, like, cameras and different sensors, like light are and stuff like that.

So those are pretty cool, too.

So anyways, let's go ahead and get started.

S o I click on get started is gonna try to make sure his fits to my page here.

Um, and at least here, they're saying Hey, make sure using nine or greater.

Okay.

Got it.

Check it.

Check.

Uh, grab a release.

So just as a caveat.

This does use unreal engine for I'm just gonna be straight with you guys.

I don't know anything about unreal engine for other than it's a game engine.

Okay?

And I might even be wrong about that.

So, um, I know I done some stuff in the past to run this, So I don't know if if they can include all the files from Unreal engine for and like, that's gonna make the game run or something.

So, like, I always try to think, like, do I have things preinstalled that would make things different for me as opposed to people watching this.

So I'm actually doing this on my main computer, So, um, might have some things already here that you don't have, so just keep that in mind.

So I'm gonna go ahead and click on the latest release.

I don't really think I want the nightly build.

So from here, the latest stable version is 08 on, then all these That sounds like a long time ago.

I wonder why That's the most stable version.

Yeah, it's been over, like, six months before since a stable version.

It's kind of weird.

Um, and At least it looks like here.

Engine new agent, class to form client side.

Sounds like these air.

Some pretty important update.

So I don't think we want the latest stable version.

Um, let's just go with the latest versions.

What?

You gave me, like, one second to load this page or you can Thanks.

Idiot.

Okay, so, um, that couldn't possibly have been a proper air anyway.

Uh, windows, please.

No windows.

I'm pretty sure they have windows support.

I'm trying to use windows.

I know some people relying on it.

He's a lamb Max, because I can record in windows better whenever you see me using Lennox, Um, I'm usually recording.

I'm using windows still to record because I do my recording and editing on windows.

So it was easier if I'm on windows.

Okay, but, um, I used linens all the time.

Don't worry, I'm okay.

I'm to survive.

Um, so I usually use a virtual machine, but in this case, I don't want to use the virtual machines.

The VM zehr kind of a pain in the butt whenever you have fullscreen applications.

So I really want windows.

Let's see if the Carla I'm getting a little sick and tired of your shenanigans.

Okay, so it does have, uh, windows here.

Experimental.

Awesome.

Um, how about this one?

Someone better?

Yes.

Okay.

Cool.

Newtown environment with narrow roads open.

Dr.

Parr, sir, and waypoints a p.

I cool.

Uh, okay.

So I would I'm just going down with this one.

If you're on Lennox, you can download these other things.

And I guess I'm just hoping there's the Windows based towns I'd have to imagine.

Um, I'd have to imagine that the towns are probably cross platform like I can't imagine why the town would be operating system specific, honestly, but Okay, so this is gonna take apparently a minute while we wait on that.

I mean, we could just kind of check out what we're what?

We're what we're dealing with here.

So, uh, looks like we wanna have pie game and dump I installed already have both of those, so make sure you do too.

Then to run it looks like we just run the e x e file on.

And then on Lennox, he would just run the shell, uh, launches a view over the city.

This is a spectator view.

So it sounds like?

Like, yeah, they have more of, like, a client and server.

So that s o you got the server.

I'm guessing this is more like your server view.

And then later, any other scripts you're gonna have will be your client.

And I don't know if they're gonna show a window or if they're just going to simply, like, connect in.

And then you grab stuff from the sensors.

I don't really know.

We'll find out.

Uh, okay.

Carla requires thes two TCP ports.

Make sure if you're having issues you might need to open those.

Cool.

Got it.

Uh, also carla.

And then the second part is N plus one, so you could change it, I guess.

Uh, okay.

So to add life to the city, we're gonna run Spawn in PC.

So again, it just sounds like there's a lot of this, like server client.

That's kind of weird, though, because I wonder if you could just, like, start the simulation with NBC's, but Okay, so it sounds like it'll just be the city, and then we can change the weather.

So definitely with the python self driving car.

Like if you're using a camera as your primary sensor.

You definitely want to have tiny week.

Whether because otherwise, like, slight changes, they're gonna just totally throw you off.

Um, if you're doing like, light are I don't know, I don't think it would really impact it, to be honest with you guys.

Uh and then finally they run this, which is probably your client.

And I guess they're using pi game.

This is my game.

So it looks like it's gonna open another window, so that would be like your client window.

So you'll have at least two windows open if you're using the same machine.

But what's kind of cool is, yeah, you can connect to a server, so python manual control.

And then with the host argument, you can pass in the host I p, which sounds like in the future I could probably host a server for people to bring in their self driving cars.

And I wonder, I wonder what kind of load like what kind of GPU load you have on the server versus on the client side, especially what if all you're trying to pull is maybe lied our data or something like that?

Or maybe the imagery at a low resolution, I wonder I wonder how that would go.

Okay, so it looks like our thing has de l'd let me go ahead and start the extraction process.

Hopefully, I didn't take too long.

And, um, I think the first thing I'd want to do so, like, generally, I'm always like I mean, the AP eyes air useful if they have good documentation, but usually places don't.

So let's go ahead and click on the python.

E p.

I reference.

Um, yes.

That's basically, you know, the index of a book.

Pretty not useful to an amateur newbie like me.

Overview.

Useless python ap a tutorial.

Okay, maybe this has a little bit of interesting information for us.

What is that?

Oh, that was digging at me because of the, uh, me.

Just meet this real quick.

Um, okay, so we've extracted everything.

So now what we can do.

Um, I'll probably check out Python a p I.

But first, let me just finish reading what I was reading here.

So in the suit, Royal Bubble blah.

Yes, it's Yes.

Copy that.

Okay, so So it looks like they're kind of separating out core concepts.

I'm gonna guess These are on drugs you got Actor.

Blueprint in world.

Actor is anything that plays a role in the simulation.

So vehicles, pedestrians in sensors.

A sensor is an actor.

Okay.

Ah.

Blueprint.

Before spotting an actor, you specify the attributes.

We provide a blueprint library with the definitions of all actors available.

I don't know if that means like they have defaults.

Hope World world represents the currently loaded map, so you can, like, probably reference the world.

Although I'm just not really sure why you would do that other than maybe initially for some reason, but to change whether.

Okay, so the world is more of probably server type.

Task is my guess.

Because I'm thinking probably your actors what you would reference for, like, sensor values, right?

Because that's basically the end of the day.

We want to move the vehicle based on the vehicle actor based on the sensor actor data.

Um Okay.

So Okay, this is starting to look more like the raw could.

So first thing I want to do is test out the those initial commands that we had.

Okay, so the first thing we need to do is run lovely.

We do have the e x e fantastic.

So, like, for example, you before, like do binaries and content and the engine buying Aires.

So maybe you don't have to install country legend for I don't know.

I'm sorry.

I'm an idiot.

Uh, okay.

So far, so good.

Oh, okay.

Okay.

My GP is starting to make some noise.

Let me move this over as much like can.

Anyway, uh, you can't really see the full screen, but that should be good enough for demo purposes.

Maybe at some point, I'll fix that.

Um, okay.

Looks a little lonely in this city.

Some sort of evacuation has taken place.

Okay, We can use our wst keys to move around.

We are flying.

Okay?

Yeah, There's definitely nobody here.

But I think that was what was to be expected, because apparently we have to load in the n p.

C s.

So let's go here.

Ah, Spawn NPC 80 python spawn in pc up.

I I am an expert python programmer, and I know that's not gonna work here.

I'm going to guess maybe they're in Python A p I, uh Carla, maybe not seeing agents now.