Repository navigation
feat(metadata): validate proposals and dispatch publication - #2567
Conversation
|
Updated in 880ac9e: correct CvT-13 384/22k metadata to the reproduced 224 × 224 processor output. The wrapper first resizes to 384px, but the inspected Hugging Face configuration with the loader-pinned Transformers 4.30.2 center-crops to 224px. Added the processor implementation as evidence; resolution and input-format assertions remain uncertain because the historical Hub revision is unpinned. This changes metadata, not model loaders or scoring. All seven CvT files passed schema, table conversion and recorded-evidence coverage checks. The local publication rehearsal published all seven, retried without duplicate revisions, and preserved score rows and displayed leaderboard ranks. No shared-dev publication was made. Evidence, exact candidate hashes and reproduction instructions. First publication still requires |
|
Follow-up publication review is now in #2571. It adds the recorded preprocessing reproduction to all seven CvT files while preserving model facts, confidence and source protections. Because this PR merged without independent approval or |
Validate metadata v2 PRs without executing submitted plugin code, and dispatch database publication after merge. Protected fields require maintainer approval on the current revision.
Companion to brain-score/brain-score.web#560. Disabled until
METADATA_V2_ENABLEDand the shared package, App, and publisher are configured.Validation: workflow YAML checked; live workflow execution remains untested.