AI that plays games with you: the four things that phrase means

Search "AI that plays games with you" and you get four completely different products wearing the same description: overlays that watch your screen and banter, research agents that can take the controls, reported patents for AI that plays instead of you, and AI characters that live inside a game and play alongside you. They deliver very different experiences, and most articles blur them together. Here's the honest map — what each one actually does today, and which one matches what you're picturing.

1. Screen-watching copilots: a buddy in your headset, not in your game

The most available option right now. Tools like HakkoAI, Questie, and Sidekick capture your screen, understand roughly what's happening, and voice-chat with you like a Discord friend spectating your run — commentary, banter, sometimes build advice. Their genuine strength is universality: they work across almost any game because they sit on top of it. Their ceiling is the same fact — they can only ever watch. The copilot can't pull aggro, can't mine while you fight, can't hold the objective. It's company, not cooperation. (We compared this category to in-world companions in depth in AI gaming companions: copilots vs in-world companions.)

2. Research agents: real hands, no product

Google DeepMind's SIMA line of research agents genuinely plays 3D games — it takes natural-language instructions and operates the controls across multiple commercial titles. NVIDIA has shown related work on agents that act in games. This is the technology that will eventually power AI teammates in big-budget titles, and it's worth knowing it exists so the marketing around lesser products doesn't fool you. But you can't download SIMA and queue up with it tonight. It's a lab result, not a launcher icon.

3. Play-for-you ghosts: the version nobody asked for

Reports of console-maker patents describe AI "ghosts" that can take over and play sections for you — grind this, farm that, finish the level while you make dinner. Whatever ships from those filings, notice what it optimizes: your absence. An AI that plays instead of you answers a different desire than an AI that plays with you. If the whole point is shared experience — someone at your side while you play — automation of the playing is the opposite of the product.

4. In-world companions: the AI is a character, and it actually does things

The fourth category puts the AI inside the game as a persistent character with its own body, personality, and agency — a teammate that exists in the same world you do. This is where we build, so concretely: in MyDopplerEffect your companion isn't an overlay narrating your session; it's a character in a top-down 2D survival world. You can dispatch it to persistent exploration, gathering, or combat work while you're away; the results and reports persist as shared history. Spatial travel for those dispatched jobs remains in development. Because its memory is persistent, it can refer back to important conversations, absences, work reports, and shared world context. How that works is covered in games where NPCs remember you. The honest limit mirrors the copilots' strength in reverse: an in-world companion only exists in its own game. It will never spectate your Elden Ring run.

Which one do you actually want?

One more distinction worth carrying out of this page: "plays with you" can mean presence (someone there while you play) or participation (someone doing things in the world with you). Copilots deliver presence today. Participation — the co-op fantasy — only exists where the AI is a first-class inhabitant of the game world. The broader taxonomy of what "AI companion game" even means is in AI companion games.