Skip to content

[model-inventory] Model alias inventory update - 2026-09-10 #59825

Closed as not planned

Description

@github-actions

Summary

  • Providers queried: OpenAI, Anthropic, Gemini, Copilot SDK, Copilot (reflect)
  • Total models found: 132 (openai) + 9 (anthropic) + 50 (gemini) + 19 (copilot-sdk) + 36 (copilot-reflect) = 246 raw entries (with overlap)
  • Proposed alias changes: 3
  • Pricing gaps found: 0 discrepancies; 15 models missing from models.json (mostly deprecated/dated snapshots), 19 historical entries not currently live
  • Playwright docs pricing table fetch: unavailable in this run (playwright-cli not present in the sandbox); billing-multiplier cross-check against the docs table was skipped, but Copilot SDK billing.tokenPrices and reflect pricing fields were cross-validated directly and agreed with models.json for every sampled model.

Provider Model Counts

Provider Models Available Status
openai 132 ✅ ok
anthropic 9 ✅ ok
gemini 50 ✅ ok
copilot-sdk 19 ✅ ok
copilot (reflect) 36 ✅ ok
copilot (docs pricing table) 0 ⚠️ playwright-cli unavailable, skipped

Raw API Fields Discovered

  • OpenAI (raw.json): id, object, created, owned_by, shutdown_date. No pricing/capability fields in the models endpoint itself; naming conventions (-mini, -nano, o1/o3/o4) remain the only signal for tiering.
  • Anthropic (raw.json): id, display_name, created_at, type, plus (on some entries) max_input_tokens, max_tokens, and a rich capabilities object (batch, citations, code_execution, context_management, effort). These capability flags are new and worth capturing in future cached inventories for reasoning/tooling gating.
  • Gemini (raw.json): name, version, displayName, description, inputTokenLimit, outputTokenLimit, supportedGenerationMethods. Token limits remain the best proxy for tiering; no explicit pricing field.
  • Copilot reflect (reflect.json): model_metadata[].pricing.default / .long_context with input, output, cachedInput, cacheWrite, threshold — matches models.json cost fields almost exactly (per-million-token dollars) and is a strong direct pricing validation source.
  • Copilot SDK (copilot-sdk-models/models.json): richest source — capabilities.limits (context/output/prompt token caps, vision limits), capabilities.supports (vision, tool_calls, reasoning_effort, adaptive_thinking, structured_outputs, streaming), billing.tokenPrices (input/output/cache/cacheWrite/longContext, in per-million-token cents), policy.state, modelPickerCategory, modelPickerPriceCategory. These are the best-structured fields for both pricing and future capability-based alias gating.

models.json Pricing Analysis

No pricing discrepancies were found. Cross-checked gpt-5-mini, gpt-5.3-codex, gpt-5.4, gpt-5.4-mini, gpt-5.5, gpt-5.6-luna/sol/terra, gpt-6-astra, grok-4.5/4.6, mai-code-1-flash-picker, mai-code-1.1-flash, claude-haiku-4.5, claude-opus-4.7/4.8, claude-opus-5, claude-sonnet-5 against both Copilot SDK billing.tokenPrices and reflect pricing.default — all values agree with pkg/cli/data/models.json / actions/setup/js/models.json (which remain identical mirrors).

Missing from models.json

Model ID Provider Inferred Pricing Basis
gpt-3.5-turbo copilot legacy, low-cost reflect (no pricing metadata returned; naming convention)
gpt-3.5-turbo-0613 copilot legacy, low-cost naming convention (dated snapshot)
gpt-4 copilot $2.50/$10.00 per 1M reflect pricing.default
gpt-4-0613 copilot legacy snapshot of gpt-4 naming convention
gpt-4-o-preview copilot legacy preview naming convention
gpt-4.1-2025-04-14 copilot dated snapshot of gpt-4.1 (already present) naming convention
gpt-41-copilot copilot internal alias of gpt-4.1 naming convention
gpt-4o-2024-05-13 copilot dated snapshot of gpt-4o (excluded family) naming convention
gpt-4o-2024-08-06 copilot dated snapshot of gpt-4o (excluded family) naming convention
gpt-4o-2024-11-20 copilot dated snapshot of gpt-4o (excluded family) naming convention
gpt-4o-mini-2024-07-18 copilot dated snapshot of gpt-4o-mini (excluded family) naming convention
text-embedding-3-small copilot embedding, non-chat naming convention
text-embedding-3-small-inference copilot embedding, non-chat naming convention
text-embedding-ada-002 copilot embedding, non-chat naming convention
trajectory-compaction copilot internal utility model, non-chat naming convention

Note: per instructions, gpt-4o-mini, gpt-4.1, gpt-4o, and gpt-5.4-nano are intentionally deprecated/excluded and are not listed above even though gpt-4.1 and gpt-5.4-nano already exist as entries in models.json. The remaining table above is almost entirely dated snapshots of already-covered or already-excluded families, plus non-chat utility/embedding models — low priority for models.json additions.

Historical entries not currently returned

These IDs exist in models.json but were not present in the live Copilot reflect/SDK inventories this run. Retained as historical records (no removal proposed):

claude-fable-5, claude-opus-4.5, claude-opus-4.6, claude-sonnet-4, claude-sonnet-4.5, claude-sonnet-4.6, gemini-2.5-pro, gemini-3-flash-preview, gemini-3.1-pro-preview, gemini-3.5-flash, gemini-3.6-flash, gemini-3.7-flash, gemini-3.8-flash, gpt-5.2, gpt-5.2-codex, gpt-5.4-nano, kimi-k2.7-code, kimi-k3, raptor-mini

(Gemini/Kimi/Raptor entries are likely just absent from this run's reflect endpoint list rather than truly discontinued — Copilot's model roster fluctuates by rollout.)

Inferred vs stored pricing discrepancies

None found — all sampled Copilot models' SDK/reflect pricing matched models.json cost fields exactly.

Proposed Alias Updates

1. What: Add gemini-3.8-flash alias
Why: gemini-3.8-flash is live in the Gemini API inventory (inputTokenLimit/outputTokenLimit present) but has no dedicated version-pinned alias, unlike gemini-3.5-flash, gemini-3.6-flash, and gemini-3.7-flash which already exist. It's currently only reachable via the generic gemini-flash wildcard.
Syntax:

{
  "gemini-3.8-flash": ["copilot/gemini-3.8*flash*", "google/gemini-3.8*flash*", "gemini/gemini-3.8*flash*"]
}

2. What: Extend the reasoning alias to include newer reasoning-capable models
Why: The Copilot SDK's capabilities.supports.reasoning_effort / adaptive_thinking flags show that gpt-5.6-luna/sol/terra, claude-opus-5, and claude-sonnet-5 now support explicit reasoning-effort control, but the current reasoning alias only targets the older o1*/o3*/o4* OpenAI family (still live, but a shrinking share of reasoning-capable models).
Syntax:

{
  "reasoning": [
    "copilot/o1*", "copilot/o3*", "copilot/o4*",
    "openai/o1*", "openai/o3*", "openai/o4*",
    "copilot/gpt-5.6*", "openai/gpt-5.6*",
    "copilot/*opus-5*", "anthropic/*opus-5*",
    "copilot/*sonnet-5*", "anthropic/*sonnet-5*"
  ]
}

3. What: Broaden the vision alias beyond Gemini-only patterns
Why: Copilot SDK data shows capabilities.supports.vision: true for nearly every current-generation model (claude-*-5, claude-opus-4.7/4.8, gpt-5.4/5.5/5.6*, gpt-6-astra, grok-4.5/4.6, mai-code-1.1-flash), so the vision alias — currently Gemini-image/flash only — undersells actual multi-vendor vision coverage.
Syntax:

{
  "vision": [
    "copilot/gemini-*image*", "google/gemini-*image*", "gemini/gemini-*image*",
    "copilot/gemini-*flash*", "google/gemini-*flash*", "gemini/gemini-*flash*",
    "sonnet", "opus", "gpt-5.4", "gpt-5.5", "gpt-5.6"
  ]
}
Full Model Lists by Provider

OpenAI (chat-relevant, sorted, excludes embeddings/whisper/tts/dall-e/moderation/davinci/babbage):
chat-latest, chatgpt-image-latest, gpt-3.5-turbo, gpt-3.5-turbo-0125, gpt-3.5-turbo-1106, gpt-3.5-turbo-16k, gpt-3.5-turbo-instruct, gpt-3.5-turbo-instruct-0914, gpt-4.1, gpt-4.1-2025-04-14, gpt-4.1-mini, gpt-4.1-mini-2025-04-14, gpt-4.1-nano, gpt-4.1-nano-2025-04-14, gpt-4o, gpt-4o-2024-05-13, gpt-4o-2024-08-06, gpt-4o-2024-11-20, gpt-4o-mini, gpt-4o-mini-2024-07-18, gpt-4o-mini-search-preview, gpt-4o-mini-transcribe, gpt-4o-search-preview, gpt-4o-transcribe, gpt-5, gpt-5-2025-08-07, gpt-5-chat-latest, gpt-5-codex, gpt-5-mini, gpt-5-nano, gpt-5-pro, gpt-5-search-api, gpt-5.1, gpt-5.1-chat-latest, gpt-5.1-codex, gpt-5.1-codex-max, gpt-5.1-codex-mini, gpt-5.2, gpt-5.2-chat-latest, gpt-5.2-codex, gpt-5.2-pro, gpt-5.3-chat-latest, gpt-5.3-codex, gpt-5.4, gpt-5.4-mini, gpt-5.4-nano, gpt-5.4-pro, gpt-5.5, gpt-5.5-pro, gpt-5.6-luna, gpt-5.6-sol, gpt-5.6-terra, gpt-6-astra, gpt-audio*, gpt-image-1*, gpt-image-2*, gpt-realtime*, o1, o1-pro, o3, o3-deep-research, o3-mini, o3-pro, o4-mini, o4-mini-deep-research, sora-2, sora-2-pro

Anthropic:
claude-haiku-4-5-20251001, claude-opus-4-5-20251101, claude-opus-4-6, claude-opus-4-7, claude-opus-4-8, claude-opus-5, claude-sonnet-4-5-20250929, claude-sonnet-4-6, claude-sonnet-5

Gemini:
antigravity-preview-05-2026, aqa, deep-research-max-preview-04-2026, deep-research-preview-04-2026, deep-research-pro-preview-12-2025, gemini-2.5-computer-use-preview-10-2025, gemini-2.5-flash, gemini-2.5-flash-image, gemini-2.5-flash-lite, gemini-2.5-flash-native-audio-, gemini-2.5-flash-preview-tts, gemini-2.5-pro, gemini-2.5-pro-preview-tts, gemini-3-flash-preview, gemini-3-pro-image, gemini-3.1-flash-image*, gemini-3.1-flash-lite*, gemini-3.1-flash-tts-preview, gemini-3.1-pro-preview*, gemini-3.5-flash, gemini-3.5-flash-lite, gemini-3.5-transcribe*, gemini-3.6-flash, gemini-3.7-flash, gemini-3.8-flash, gemini-embedding-, gemini-flash-latest, gemini-flash-lite-latest, gemini-omni-1.1-flash, gemini-omni-flash-preview, gemini-pro-latest, gemini-robotics-er-2-preview, gemma-4-26b-a4b-it, gemma-4-31b-it, lyria-3-clip-preview, lyria-3-pro-preview, lyria-3.5, nano-banana-pro-preview, veo-3.1-

Copilot SDK:
auto, claude-sonnet-5, claude-opus-5, claude-opus-4.8, claude-opus-4.7, claude-haiku-4.5, gpt-5.6-sol, gpt-5.6-terra, gpt-5.6-luna, gpt-5.5, gpt-5.4, gpt-5.4-mini, gpt-5.3-codex, gpt-5-mini, mai-code-1.1-flash, mai-code-1-flash-picker, grok-4.5, gpt-6-astra, grok-4.6

Copilot (reflect):
claude-haiku-4.5, claude-opus-4.7, claude-opus-4.8, claude-opus-5, claude-sonnet-5, gpt-3.5-turbo, gpt-3.5-turbo-0613, gpt-4, gpt-4-0613, gpt-4-o-preview, gpt-4.1, gpt-4.1-2025-04-14, gpt-41-copilot, gpt-4o, gpt-4o-2024-05-13, gpt-4o-2024-08-06, gpt-4o-2024-11-20, gpt-4o-mini, gpt-4o-mini-2024-07-18, gpt-5-mini, gpt-5.3-codex, gpt-5.4, gpt-5.4-mini, gpt-5.5, gpt-5.6-luna, gpt-5.6-sol, gpt-5.6-terra, gpt-6-astra, grok-4.5, grok-4.6, mai-code-1-flash-picker, mai-code-1.1-flash, text-embedding-3-small, text-embedding-3-small-inference, text-embedding-ada-002, trajectory-compaction

Notes

  • playwright-cli was not available in this run's sandbox (command not found); the docs pricing table cross-check (Step 2.5) could not be completed. All pricing validation for this run instead relied on Copilot SDK billing.tokenPrices and reflect pricing fields directly, both of which agreed with models.json exactly wherever sampled — no discrepancies found.
  • kiwi and raptor-mini aliases have no matching live models in this run's inventories; kept as-is per instructions (no live model = historical/forward-looking, not stale enough to remove without human review).
  • coding, summarization, reasoning, and vision semantic aliases already exist in pkg/workflow/data/model_aliases.json (matching the Step 4 task-oriented ask), so no wholly new semantic aliases were proposed — only refinements to reasoning and vision to reflect broader current-generation model support.
  • sonnet, opus, haiku, gpt-5-mini, gemini-flash, gemini-pro glob patterns already correctly match all new model generations (*-5, 4.7, 4.8, etc.) found in this run; no changes needed there.

Generated by 📦 Daily Model Inventory Checker · copilot · auto · 135.8 AIC · ⌖ 12.8 AIC · ⊞ 14K · ◷

  • expires on Sep 16, 2026, 4:10 PM UTC-08:00

Activity

  1. github-actions commented on Sep 11, 2026

    @github-actions
    ContributorAuthor

    This issue is being closed as outdated. A newer issue has been created: #60071

    View newer issue


    This action was performed automatically by the Daily Model Inventory Checker workflow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions