Summary
- Microsoft is using Copilot, an AI agent, to assist gamers with achieving objectives in-game.
- Copilot will be accessible from the Game Bar and can be used in voice mode to provide tips and guidance.
- Copilot can analyze screenshots of gameplay to offer explanations and help gamers progress through challenging levels.
You know, back in my day, when you wanted to know how to beat a level or craft a specific item in a game, you had to get on your bike, go to an internet cafe, and print out 30 pages of a GameFAQs page that re-designed the game's logo in ASCII art. Now you turn on Twitch and stream your gameplay, and you have hordes of people telling you exactly what you should do in varying degrees of rage.
Well, Microsoft is adding a new way to tell you what you need to do next. It uses an AI agent to take a look at what you're doing in-game, listens to what you want to achieve, and then looks through its database to find your solution. And you're never going to guess what AI agent Microsoft is using to do this. Well...yeah, okay, it's Copilot. You got it.
Microsoft's new Edge feature will make you forget all about Perplexity and Chrome
And it won’t cost you a thing (for now).
Microsoft adds Copilot-based gaming help to the Game Bar for Insiders
In a post on the Xbox Wire, the company explains how Copilot can help you game better. The gist is that Copilot will live inside the Game Bar, and you can invoke it when you're feeling stuck. If you already use the Game Bar to do stuff in your games, it should just slide on in without any issue.
Of course, having to bring up the Game Bar so you can quickly type how to kill the huge demon boss making its way toward you is unideal. Fortunately, you don't need a keyboard to use it:
Pin the Gaming Copilot widget and use Copilot in Voice Mode while you’re actively playing any game on PC. This lets you talk to Copilot and get help if you’re stuck or need tips, without breaking away from gameplay. To do this, navigate to the Gaming Copilot widget, select the “Microphone” from the left navigation bar, begin a conversation, pin the widget, and continue the conversation seamlessly and at any time while you return to your gameplay.
Microsoft also gives Copilot the ability to look at screenshots of your game. If you're looking at something weird and you want more context, pass an image over to Copilot, ask it what it is, and it'll do its best to explain it. Humorously, the example Microsoft gives for this feature (and the same one used in the image at the very top of the article) involves someone using Copilot to identify one of the Kraken's tentacles during a Sea of Thieves session. Let's hope Copilot can respond quickly enough to save you from being snagged by one.
This new feature isn't ready for release just yet, but if you join the Xbox Insiders Program, you should gain access to the beta. And if you like the sound of mixing the power of AI with the bustling gaming scene, be sure to catch up on what Nvidia is doing with G-Assist.
