Skip to content

[Tech Debt] Update stale OpenAI default model gpt-3.5-turbo to gpt-4o-mini #905

Closed

Description

@weiqingy

Search before asking

  • I searched in the issues and found nothing similar.

Description

The OpenAI Chat Completions chat model defaults to gpt-3.5-turbo when the caller omits model. This is a legacy OpenAI model — it has been superseded by cheaper, more capable small models, and OpenAI itself steers new integrations away from it. A user who takes the default today silently gets an outdated model.

The stale default lives in both language runtimes and the docs, so a user hits it regardless of which API they use:

  • Java — OpenAICompletionsSetup.DEFAULT_MODEL (integrations/chat-models/openai/src/main/java/org/apache/flink/agents/integrations/chatmodels/openai/OpenAICompletionsSetup.java:61)
  • Python — DEFAULT_OPENAI_MODEL (python/flink_agents/integrations/chat_models/openai/openai_chat_model.py:38)
  • Docs — the OpenAICompletionsSetup parameter tables for both languages (docs/content/docs/development/chat_models.md)

The Java Javadoc example already uses gpt-4o-mini (OpenAICompletionsSetup.java:45), so the code base is already inconsistent with its own default.

Proposed fix: update the default in both runtimes and the docs to gpt-4o-mini — the current low-cost successor to gpt-3.5-turbo, and the value the Javadoc example already demonstrates. This keeps a sensible zero-config default while dropping the legacy model, and it keeps Java and Python in parity.

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Activity

  1. added
    tech debt[Issue Type] User-unaware issues, such as code refactor and infrastructure maintenance.
    priority/majorDefault priority of the PR or issue.
    on Jul 15, 2026
  2. self-assigned this
    on Jul 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

fixVersion/missingThe Bot applies this label when fixVersion is not set.priority/majorDefault priority of the PR or issue.tech debt[Issue Type] User-unaware issues, such as code refactor and infrastructure maintenance.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions