You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
k must have shape (batch_size, seqlen_k, num_heads_k, head_size_og) #5
and in the code, collect_attention is set False, the following set is not taking effect."You can change the "inference_type"(line 27 in generate_sr_big_cli.sh) to "ar"(parallel size=1), "ar2"(parallel size = block_batch(line 28)) or "full"(generate the entire image in one forward)."
Activity
rainsoulsrx commentedon May 21, 2024
and in the code, collect_attention is set False, the following set is not taking effect."You can change the "inference_type"(line 27 in generate_sr_big_cli.sh) to "ar"(parallel size=1), "ar2"(parallel size = block_batch(line 28)) or "full"(generate the entire image in one forward)."
yzy-thu commentedon May 22, 2024
collect_attention is a debug parameter, irrelevant to inference. Why you need infer_sr_scale==1? I haven't tested this.
Dorniwang commentedon May 28, 2024
yeah, it doesn't work, when i specify the inference_type=ar2 manually, it will give this error