is this technical discussion or self promotion? lol still fugly and slow BUT (attached video) (1.) llava model steering itself around a UE environment (2.) making decisions based on looking through the camera about what's interesting and not (3.) and acting accordingly, investigating what's in front of it or looking for something else I've solved 1/2 the speed problems; I'm working on the other half-- ideally it could make about a decision a second-- not bad for starters. basically obsessed right now with these virtual robotics/game agent use cases -- think in the future, I'm going to try to have this thing "print cities" like in this example https://delta.center/ai-construction/ except those agents are dumb but llava can make aesthetic determinations, so I'm going to try to have it build "actual architecture" eventually, like this but not in voxels

Amazing progress @Ari Kalinowski (they/them) (Delta_Ark)!

I don't do minecraft, I do unreal, but I have the weird feeling I may end up in minecraft way down the road... A lot of the best agent game work is happening there.