Skip to content

[5/10] Move draft models and layers to canonical paths - #1044

Draft
jiapingW wants to merge 1 commit into
split/config-weightsfrom
split/config-03-components
Draft

jiapingW wants to merge 1 commit into
split/config-weightsfrom
split/config-03-components

Conversation

@jiapingW

@jiapingW jiapingW commented Oct 29, 2026 •

Copy link
Copy Markdown
Collaborator

Move models into modeling/draft/models and update imports and mock targets. Rename llama3_eagle.py to models/eagle3.py; place convolution, attention backends and ring parallelism in their own layer packages. Move the remaining tensor-parallel embedding, linear and LM head primitives from specforge/layers/ into models/layers/parallel/, and update their tests and ownership rules. Remove the old import paths.

Component extraction follows in a separate PR.

Depends on #1059.

Validation: 637 CPU-suite tests completed, 48 skipped. Source files are moved without logic changes. Tensor-parallel components and their GPU test modules import successfully; multi-GPU execution was not exercised.

Stack: #1042 → #1043 → #1058 → #1059 → #1044 → #1060 → #1061 → #1052 → #1045 → #1046.
Independent CPU CI: #1053.

@jiapingW
jiapingW force-pushed the split/config-weights branch from 3c46ae2 to eaa788e Compare November 1, 2026 06:11
@jiapingW
jiapingW force-pushed the split/config-03-components branch from e80e815 to e9d1723 Compare November 1, 2026 06:11

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant