Skip to content

RuntimeError: Triton Error [CUDA]: an illegal memory access was encountered #141

Open

Description

@RhythmOfTheRain-Byte

I encountered the following issue when running the code below

python turbodiffusion/inference/wan2.1_t2v_infer.py
--model Wan2.1-1.3B
--dit_path checkpoints/TurboWan2.1-T2V-1.3B-480P-quant.pth
--resolution 480p
--prompt "A stylish woman walks down a Tokyo street filled with warm glowing neon and animated city signage. She wears a black leather jacket, a long red dress, and black boots, and carries a black purse. She wears sunglasses and red lipstick. She walks confidently and casually. The street is damp and reflective, creating a mirror effect of the colorful lights. Many pedestrians walk about."
--num_samples 1
--num_steps 4
--quant_linear
--attention_type sagesla
--sla_topk 0.1

The platform is an NVIDIA B200 GPU. The Triton version is :
pytorch-triton 3.2.0+git4b3bb1f8b.nvinternal
triton 3.4.0

File "TurboDiffusion/lib/python3.12/site-packages/triton/runtime/jit.py", line 617, in run
kernel.run(grid_0, grid_1, grid_2, stream, kernel.function, kernel.packed_metadata, launch_metadata,
File "/envs/TurboDiffusion/lib/python3.12/site-packages/triton/backends/nvidia/driver.py", line 708, in call
self.launch(gridX, gridY, gridZ, stream, function, self.launch_cooperative_grid, self.launch_pdl,
RuntimeError: Triton Error [CUDA]: an illegal memory access was encountered

After modifying core.py to make the code run, the generated video was invalid. Could you please advise me on how to resolve this issue? Thank you very much!

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions