Shoot this dot, go to that dot, bring “x” to this dot…
Anything requiring critical thinking like a puzzle, the bot just brute forces trying every possible outcome until something works.
It works because games have a finite set of options and at least one progresses. The real world isn’t that clean, and you don’t get infinite chances to get 1 correct solution.
Yes! I went kind of hard into technical Minecraft during COVID and used it a lot. It’s more of an automation framework, it’s a terrific piece of software but not “AI”.
I’ve dicked around with a baritone+LLM setup but it’s really hard to get the model to do anything worthwhile. The model doesn’t really see the world around it, just whatever textual representation you manage to make of it. It’s slow and frustrating and only gets the very basic tasks right.
I would imagine a vision+interaction model would be leaps and bounds better at any interesting application. Ultimately I’d love to see a civilization of bots building its own base with mega farms and shit…
Did you see the one where someone trained bots to do crystal pvp on 2b2t? It was fascinating and actually “AI” (not LLM AI but what we would’ve called AI pre LLM/gen AI lol). I don’t remember much else. Basically the bots actually saw the screen, not at full resolution, but enough to really see and move and attack players in a very advanced way. (Crystal PVP involves putting down end crystals and detonating them, it’s much more involved than just clicking with a sword or aiming arrows.)
I totally missed that ! Thanks for the reference I’ll try to find it.
I used to hang with a crew that was really into crystal pvp, this brings back memories. Personally I find it pretty boring but the coding part on their custom clients was pretty fun.
If they’re as good at the game as LLMs are at writing, the bots would probably try to build a Nether portal using black wool instead of obsidian, then set it on fire, then die burning on said fire.
I want AI to do my chores not play my games.
Sorry, AI must only be inserted into places it isn’t actually wanted.
Silver lining: maybe it could be used to make some games more accessible for people with disabilities
Right? Like, figure out how to sort and fold laundry.
deleted by creator
Work is hard, modern games are easy.
Shoot this dot, go to that dot, bring “x” to this dot…
Anything requiring critical thinking like a puzzle, the bot just brute forces trying every possible outcome until something works.
It works because games have a finite set of options and at least one progresses. The real world isn’t that clean, and you don’t get infinite chances to get 1 correct solution.
Honestly I’d be curious about what a couple Minecraft bots could do. If you gave them a roadmap to endgame gear, what kind of farms would they build?
Sort of already exists as Baritone. https://github.com/cabaletta/baritone I’m not sure what all it can and can’t do but it’s pretty sophisticated.
Edit: Note that, as far as I know, none of it is AI in the modern usage of the term.
Yes! I went kind of hard into technical Minecraft during COVID and used it a lot. It’s more of an automation framework, it’s a terrific piece of software but not “AI”.
I’ve dicked around with a baritone+LLM setup but it’s really hard to get the model to do anything worthwhile. The model doesn’t really see the world around it, just whatever textual representation you manage to make of it. It’s slow and frustrating and only gets the very basic tasks right.
I would imagine a vision+interaction model would be leaps and bounds better at any interesting application. Ultimately I’d love to see a civilization of bots building its own base with mega farms and shit…
Did you see the one where someone trained bots to do crystal pvp on 2b2t? It was fascinating and actually “AI” (not LLM AI but what we would’ve called AI pre LLM/gen AI lol). I don’t remember much else. Basically the bots actually saw the screen, not at full resolution, but enough to really see and move and attack players in a very advanced way. (Crystal PVP involves putting down end crystals and detonating them, it’s much more involved than just clicking with a sword or aiming arrows.)
I totally missed that ! Thanks for the reference I’ll try to find it.
I used to hang with a crew that was really into crystal pvp, this brings back memories. Personally I find it pretty boring but the coding part on their custom clients was pretty fun.
If they’re as good at the game as LLMs are at writing, the bots would probably try to build a Nether portal using black wool instead of obsidian, then set it on fire, then die burning on said fire.