Skip to content

[docs] Document the successive Python job limitation on a session cluster - #1282

Merged
wenjin272 merged 1 commit into
apache:mainfrom
sangkyoonnam:docs/pemja-parent-first
Oct 20, 2026
Merged

wenjin272 merged 1 commit into
apache:mainfrom
sangkyoonnam:docs/pemja-parent-first

Conversation

@sangkyoonnam

@sangkyoonnam sangkyoonnam commented Oct 19, 2026 •

Copy link
Copy Markdown
Contributor

Linked issue: #1281

Purpose of change

Document the known limitation of successive Flink Agents jobs that use the Python runtime on a session cluster (#943, #1281), including Java jobs with Python components. Setup tells users to restart the cluster before submitting another such job and lists the startup errors seen when the distribution JAR isn't in $FLINK_HOME/lib. The Quickstart overview links to it. This replaces the earlier parent-first recommendation.

Tests

The docs build with Hugo 0.110.0, and the new anchor and the Quickstart link to it resolve. The reproductions are in #1281; on macOS with main and stock pemja, restarting the cluster let a first job produce output again.

API

No.

Documentation

  • doc-needed
  • doc-not-needed
  • doc-included

Was this patch authored or co-authored using generative AI tooling?

  • Yes
  • No

Generated-by: Claude Code 2.1.303 (Claude Opus 5.5)

@github-actions github-actions Bot added doc-included Your PR already contains the necessary documentation updates. fixVersion/0.4.0 priority/major Default priority of the PR or issue. labels Oct 19, 2026
…ster

Generated-by: Claude Code 2.1.303 (Claude Opus 5.5)
@sangkyoonnam
sangkyoonnam force-pushed the docs/pemja-parent-first branch from 9d2e8f3 to 88a6e8f Compare October 20, 2026 04:38
@sangkyoonnam sangkyoonnam changed the title [docs] Load pemja parent-first for PyFlink jobs on a session cluster [docs] Document the successive Python job limitation on a session cluster Oct 20, 2026
@github-actions github-actions Bot added doc-included Your PR already contains the necessary documentation updates. and removed doc-included Your PR already contains the necessary documentation updates. labels Oct 20, 2026

@wenjin272 wenjin272 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking this on. LGTM

@wenjin272
wenjin272 merged commit d2898ea into apache:main Oct 20, 2026
28 of 29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

doc-included Your PR already contains the necessary documentation updates. fixVersion/0.4.0 priority/major Default priority of the PR or issue.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants