8000
Hi, I notice there is a do_concat parameter, but I can not figure out it's role in your project, could you please explain it?
It's an ablation study setting. means only doing attention inside each block
Activity
yzy-thu commentedon Jul 5, 2024
It's an ablation study setting. means only doing attention inside each block