fix(auto-model): fix auto model

[Sg312]

Summary

Fix auto model

Type of Change

• Bug fix

Testing

Manual

Checklist

• Code follows project style guidelines
• Self-reviewed my changes
• Tests added/updated and passing
• No new warnings introduced
• I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment

Project	Deployment	Actions	Updated (UTC)
docs	Skipped		Aug 1, 2026 12:07am

[greptile-apps]

Greptile Summary

This PR extends sim-auto resolution to evaluator and router handlers.

• Resolves the pseudo-model before provider validation and execution.
• Preserves sim-auto as the public output model while using the selected concrete model internally.
• Adds billable model-routing cost to block output totals.
• Adds coverage for evaluator and router V2 auto-model execution and routing-cost accounting.

Confidence Score: 5/5

The PR appears safe to merge with no concrete changed-code failure identified.

The evaluator and router paths resolve and validate the concrete provider model before invocation, retain established auto-model output behavior, and add the separate classifier charge exactly once to the settled provider total.

Important Files Changed

Filename	Overview
apps/sim/executor/handlers/evaluator/evaluator-handler.ts	Resolves sim-auto before evaluator execution, validates the selected model, and includes routing cost while preserving the pseudo-model output identity.
apps/sim/executor/handlers/router/router-handler.ts	Adds shared auto-model resolution to both router implementations and consistently applies the selected model, preamble, and routing cost.
apps/sim/lib/model-router/resolve.ts	Introduces a focused helper that adds a positive billable routing charge to an already-settled provider cost.

Sequence Diagram

sequenceDiagram
  participant Block as Evaluator/Router
  participant Resolver as Auto Model Resolver
  participant Provider as Selected Provider
  Block->>Resolver: Resolve sim-auto from task signals
  Resolver-->>Block: Concrete model and routing cost
  Block->>Block: Validate selected model
  Block->>Provider: Execute using concrete model
  Provider-->>Block: Result and provider cost
  Block->>Block: Add billable routing cost
  Block-->>Block: Return output with model sim-auto

Loading

_{Reviews (1): Last reviewed commit: "Fix auto model" | Re-trigger Greptile}