[Bug] --lora-apply-mode immediately on a quantized Qwen-Image-2.1 GGUF applies 0/N LoRA tensors then aborts (Vulkan)

Git commit

commit 2f88688 (prebuilt win-vulkan-x64 release)

Operating System & Version

Windows 11 (x64)

GGML backends

Vulkan — Intel(R) Iris(R) Xe Graphics (uma: 1 | fp16: 1 | bf16: 0), ~14966 MiB device budget

Command-line arguments used

sd-cli.exe \
  --diffusion-model models/qwen/qwen-image-2.1-Q4_K_M.gguf \
  --lora-model-dir models/lora \
  --lora-apply-mode immediately \
  --vae models/qwen/qwen_image_2.1_vae.safetensors \
  --llm models/qwen/Qwen3VL-8B-Instruct-Q4_K_M.gguf \
  -p "a lovely cat <lora:Qwen-Image-2.1-viggle-turbo-4step-lora-r64:1.0>" \
  --cfg-scale 1.0 --sampling-method euler --steps 4 \
  -W 512 -H 512 --diffusion-fa --seed 42 --backend vulkan0 -v

Model: Qwen-Image-2.1 quantized to Q4_K_M (GGUF). LoRA: a PEFT LoRA with 454 tensors using lora_A/lora_B naming — correctly converted by name_conversion.cpp and applied successfully in at_runtime mode.

Steps to reproduce

Use a quantized Qwen-Image-2.1 model (Q4_K_M GGUF).
Reference a LoRA via the prompt tag <lora:name:1.0>.
Force --lora-apply-mode immediately.

What you expected to happen

The LoRA is applied. docs/lora.md says the immediately mode "may have precision and compatibility issues with quantized parameters", so at minimum a clean error message — not a hard abort with no output.

What actually happened

The log confirms the mode was accepted:

[INFO ] diffusion_engine.cpp:1677 - apply lora immediately

Then it reports zero tensors applied, with no warning:

[INFO ] lora.hpp:1004 - (0 / 454) LoRA tensors have been applied, lora_file_path = ...\Qwen-Image-2.1-viggle-turbo-4step-lora-r64.safetensors

Then it aborts on a raw (unlogged) assertion and exits with code 127, writing no output file:

D:\a\stable-diffusion.cpp\stable-diffusion.cpp\ggml\src\ggml-backend.cpp:930: pre-allocated tensor (model.diffusion_model.modulation.1.weight (copy of  (reshaped) (view))) in a buffer (Vulkan0) that cannot run the operation (CPY)

Reproduced 2/2 runs. With the default --lora-apply-mode auto (which the docs say selects at_runtime for quantized models), the exact same command applies (454 / 454) LoRA tensors have been applied and generates an image normally.

Logs / error messages / stack trace

[INFO ] diffusion_engine.cpp:1677 - apply lora immediately
[INFO ] lora.hpp:1004 - (0 / 454) LoRA tensors have been applied, lora_file_path = ...\Qwen-Image-2.1-viggle-turbo-4step-lora-r64.safetensors
D:\a\stable-diffusion.cpp\stable-diffusion.cpp\ggml\src\ggml-backend.cpp:930: pre-allocated tensor (model.diffusion_model.modulation.1.weight (copy of  (reshaped) (view))) in a buffer (Vulkan0) that cannot run the operation (CPY)

exit code: 127

Additional info

Related: issue [Bug] Cannot apply lora immediately anymore (vulkan) #1010 / PR fix: make the immediate LoRA apply mode work better when using Vulkan #1021 fixed a different assertion for immediate-mode LoRA on Vulkan (ggml-vulkan.cpp:6552 GGML_ASSERT(y_non_contig || !qy_needs_dequant) inside ggml_vk_mul_mat_q_f16). This build already includes that fix, yet the immediate path still aborts on Qwen-Image-2.1 — with the CPY / backend-buffer assert above instead. It looks like a distinct code path rather than a regression of [Bug] Cannot apply lora immediately anymore (vulkan) #1010.
No OOM is involved: DiT Q4_K_M 4005 MiB + Conditioner 4789 MiB + VAE 1288 MiB all fit in the 14966 MiB Vulkan0 budget.
Minor, possibly intended: passing --lora-model-dir <dir> without referencing any LoRA in the prompt applies nothing and prints no warning, while the example in docs/lora.md (-p "a lovely cat" --lora-model-dir ../models) reads as if the directory's LoRAs are applied automatically. A warning would have saved some debugging time.

--lora-apply-mode immediately targetting quantized models is only supported for some quantized types, depending on backends. Not sure if the crash is expected though

I am trying to apply Qwen-Image-2.1-Fun-Acc-4Step Lora with either mode auto or apply immediately. It is not being applied.

Are these 4 steps Loras supported ?

Logs

[INFO ] ggml_graph_cut.cpp:1032 - qwen_image_2_1 build cached graph cut plan done (taking 2 ms)
|==================================================| 4/4 - 26.14s/it
[INFO ] image.cpp:899 - sampling completed, taking 108.43s
[INFO ] image.cpp:911 - generating 1 latent images completed, taking 108.43s
[INFO ] image.cpp:554 - decoding 1 latents
[INFO ] ggml_graph_cut.cpp:1032 - wan_vae build cached graph cut plan done (taking 1 ms)
[VERBOSE] model_loader.cpp:1108 - loading 128/238 tensors from /home/tipu/AI/image/Qwen-Image-21/qwen_image_2.1_vae_bf16.safetensors
|##################################################| 128/128 - 398.92MB/s
[INFO ] model_loader.cpp:1378 - loading tensors completed, taking 1.21s (read: 0.03s, memcpy: 0.00s, convert: 0.72s, copy_to_backend: 0.13s)
[VERBOSE] model_manager.cpp:490 - model manager prepared params backend buffers (482.81 MB, 128 tensors, 1 blocks, VRAM) on Vulkan0
[VERBOSE] ggml_runner.cpp:1019 - wan_vae compute buffer size: 2556.25 MB(VRAM) on Vulkan0 (peak across 1 segment)
[VERBOSE] vae.hpp:351 - computing vae decode graph completed, taking 8.57s
[INFO ] image.cpp:620 - latent 1 decoded, taking 8.57s
[INFO ] image.cpp:624 - decode_first_stage completed, taking 8.57s
[INFO ] diffusion_engine.cpp:1776 - runtime_lora_models:
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.17.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.9.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.7.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.26.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.23.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.24.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.img_mlp.proj.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.20.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.8.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.27.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.5.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.16.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.2.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.19.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.18.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.28.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.13.attn.to_out.0.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.22.attn.to_q.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.14.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.25.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.0.img_mlp.gate_layer.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.15.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.29.attn.norm_k.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.img_mlp.proj.lora_up|
(bf16): shape(64, 12288, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.6.attn.to_q.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.30.attn.norm_q.weight|
(bf16): shape(128, 1, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.3.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.to_v.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.to_v.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.4.attn.to_out.0.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.31.img_mlp.out.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.1.attn.to_k.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.11.img_mlp.out.lora_down|
(bf16): shape(12288, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.21.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.10.img_mlp.gate_layer.lora_down|
(bf16): shape(4096, 64, 1, 1)
[WARN ] lora.hpp:988 - unused lora tensor |lora.model.diffusion_model.transformer_blocks.12.attn.to_k.lora_up|
(bf16): shape(64, 4096, 1, 1)
[WARN ] lora.hpp:1000 - Only (0 / 512) LoRA tensors have been applied, lora_file_path = /home/tipu/AI/image/Qwen-Image-21/Qwen-Image-2.1-Fun-Acc-4Step.safetensors

For a gfx1100 / ROCm 10.0 data point: on RDNA3 (RX 7900 XTX), Qwen-Image-2.1 Q8_0 GGUF + PEFT LoRA (454 tensors, rank-64 bf16), --lora-apply-mode at_runtime applies all 454/454 tensors cleanly on the ROCm backend, no crash.
This was part of a 2026-10-02 audit (commit ffe3319), so the at_runtime path is a confirmed-stable alternative for RDNA3 + quantized base.

I haven't tested immediately against a quantized Q8_0 on gfx1100, so I can't confirm whether it's the same crash signature on ROCm or Vulkan-only.
The docs' note about "precision and compatibility issues with quantized parameters" covers it, but a clean "unsupported for this quant type on this backend" error would help users who hit it.

Navigation Menu

Repository navigation

[Bug] --lora-apply-mode immediately on a quantized Qwen-Image-2.1 GGUF applies 0/N LoRA tensors then aborts (Vulkan) #2083

Git commit

Operating System & Version

GGML backends

Command-line arguments used

Steps to reproduce

What you expected to happen

What actually happened

Logs / error messages / stack trace

Additional info

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

[Bug] --lora-apply-mode immediately on a quantized Qwen-Image-2.1 GGUF applies 0/N LoRA tensors then aborts (Vulkan) #2083

Description

Git commit

Operating System & Version

GGML backends

Command-line arguments used

Steps to reproduce

What you expected to happen

What actually happened

Logs / error messages / stack trace

Additional info

Activity

stduhpf commented on Sep 30, 2026

engrtipusultan commented on Oct 1, 2026

farawayso commented on Oct 3, 2026

Metadata

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Issue actions