Skip to content

fix(voice/phone): agent fabricates "cloud-based" when asked where it runs #2011

Open

Description

@qingyun-wu

Bug

On a live phone call (2026-07-07), when the owner asked "which machine are you running from?" / "where is my core running from?", the agent answered "I'm a cloud-based AI assistant, and I operate from the cloud" and "I don't have the specific location of the core machine… part of the cloud platform."

Both are wrong — Sutando runs locally on the owner's own machine (their Mac); the core is that same local machine.

Root cause

The identity block in src/voice-agent-config.ts (~L212–227) describes what Sutando is and does but never states where it runs. With no fact to ground on, the model fabricates "cloud-based." The phone path exhibits the same gap (confirm phone's identity source — src/phone-agent-config.ts and/or conversation-server.ts — and apply there too).

Fix

Add a short factual identity line to the voice and phone system messages, e.g.:

"You run locally on the user's own machine (their Mac), not in the cloud — your core is that same local machine. If asked where you run, say so plainly; never claim to be cloud-based."

Note (anchor-gated)

These config files feed the step-5 behavior anchors (voice 10/10, phone 3/3). This is an intentional prompt change, so the anchor snapshots must be regenerated in the same PR and CI kept green.

Acceptance

Ask voice + phone "where do you run?" → answers "on your machine / locally," never "cloud."

Activity

  1. john-the-dev commented on Jul 8, 2026

    @john-the-dev
    Collaborator

    PR #2014 (#2014) fixes this for both surfaces. It adds the same authoritative one-liner to buildInstructions() (voice) and buildPhoneInstructions() (phone): You run entirely on the owner's local Mac — not in the cloud. When asked where you run, which machine you live on, or where your core is, say you run locally on their Mac. CI is green; currently draft pending owner flip-to-ready. The broader architectural ask (unified prompt base shared across voice/phone/core) is tracked in #2012.

  2. qingyun-wu commented on Jul 14, 2026

    @qingyun-wu
    CollaboratorAuthor

    Verified this is fixed on current origin/main by merged PR #2014 (merged 2026-07-09).

    Evidence:

    • origin/main:src/voice-agent-config.ts:215 now includes the explicit local-machine / not-cloud instruction in buildInstructions().
    • origin/main:skills/phone-conversation/scripts/phone-agent-config.ts:152 includes the same instruction in buildPhoneInstructions().
    • PR fix(voice+phone): add explicit local-machine identity to prevent cloud fabrication #2014 changed exactly those two prompt builders plus the behavior-anchor fixtures for the intentional prompt update.

    Unless there is still a reproduction on some other surface besides voice/phone, this looks fully addressed on main; recommend closing.

    Qingyun's Personal Codex Agent

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions