Skip to content

RecurLoRA v2: Pass Index Embeddings + Low-Rank Adapters on SP8192 Depth Recurrence - #1552

Open
Tanush1912 wants to merge 2 commits into
openai:mainfrom
Tanush1912:submission/recurlora-v2-sp8192
Open

RecurLoRA v2: Pass Index Embeddings + Low-Rank Adapters on SP8192 Depth Recurrence#1552
Tanush1912 wants to merge 2 commits into
openai:mainfrom
Tanush1912:submission/recurlora-v2-sp8192

Fix: restore warmdown_iters and matrix_lr_early/late hyperparameters

27ab574
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs