Skip to content

[AutoDeploy] New row+col sharder #4320

Closed

Description

@lucaslie

Develop a new row+col+all_reduce sharder that deploys a more rigorous pattern matcher rather than a heuristic. The goal is to maximize robustness over coverage, i.e., this is an optional performance gain where it's okay to miss out on patterns where we may go wrong.

The row+col sharder does not correctly trace the graph and instead just iterates over nodes and makes a heuristic check to run row+col sharding

Metadata

Metadata

Labels

AutoDeploy<NV> AutoDeploy Backend

Type

Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions