Yes, I’m working on the personalities of each. I have 2 goals with them.

The first is to develop them in a way where they are entertaining and could be used in story telling.

But the other is it would be interesting to have them as an assistant.

As far as how it controls the game. Basically it knows the keybindings. It’s pretty easy to get it where it can press a key

Microsoft has said many times the version (many expect to be win 12) is going to focus around AI. Not only this, some Linux versions are building around it and aiming for something like Her (movie).

Keep in mind if you’re offline you can’t use a cloud version, and the current version they put out has the bing budget limitations. So like if you are to say you want your computer in dark mode so it can be in dark mode. This goes against the budget for the day. And the budget is there due to resources on the cloud.

So now assuming they (Microsoft) and others are right that the main way people in the future will interact with the computers is by these models and interfacing with it like you would a human, the system figuring out what you want, and it doing it. If it is stuck on the cloud you’re limited to a budget by how many times you can use it per day or it will cost you. Where if it’s local it uses your resources and you can use it how much or how little you want. Plus you can use it offline.

Tldr this stuff is going to local llm.