Skip to content

feat(metadata): validate proposals and dispatch publication - #2567

Merged
KartikP merged 6 commits into
masterfrom
codex/metadata-contributions
Oct 2, 2026
Merged

KartikP merged 6 commits into
masterfrom
codex/metadata-contributions

Conversation

@KartikP

@KartikP KartikP commented Sep 30, 2026

Copy link
Copy Markdown
Collaborator

Validate metadata v2 PRs without executing submitted plugin code, and dispatch database publication after merge. Protected fields require maintainer approval on the current revision.

Companion to brain-score/brain-score.web#560. Disabled until METADATA_V2_ENABLED and the shared package, App, and publisher are configured.

Validation: workflow YAML checked; live workflow execution remains untested.

@KartikP

KartikP commented Oct 2, 2026

Copy link
Copy Markdown
Collaborator Author

Updated in 880ac9e: correct CvT-13 384/22k metadata to the reproduced 224 × 224 processor output. The wrapper first resizes to 384px, but the inspected Hugging Face configuration with the loader-pinned Transformers 4.30.2 center-crops to 224px. Added the processor implementation as evidence; resolution and input-format assertions remain uncertain because the historical Hub revision is unpinned. This changes metadata, not model loaders or scoring.

All seven CvT files passed schema, table conversion and recorded-evidence coverage checks. The local publication rehearsal published all seven, retried without duplicate revisions, and preserved score rows and displayed leaderboard ranks. No shared-dev publication was made.

Evidence, exact candidate hashes and reproduction instructions. First publication still requires metadata-source-override and independent maintainer approval on this exact PR head; an administrator merge alone does not satisfy the publisher gate.

@KartikP
KartikP merged commit a60d480 into master Oct 2, 2026
11 checks passed
@KartikP

KartikP commented Oct 2, 2026

Copy link
Copy Markdown
Collaborator Author

Follow-up publication review is now in #2571. It adds the recorded preprocessing reproduction to all seven CvT files while preserving model facts, confidence and source protections.

Because this PR merged without independent approval or metadata-source-override, use the independently approved and merged #2571 for initial dev publication. Evidence and successful local publication/retry checks. No shared-dev writes have been made.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant