About visualization of routed region and attention map

[go-ahead-maker]

Hi author,
BiFormer is such inspiring work! I wonder if you could provide the demo code for the visualization of the routed key-value region, or describe how can i get similar results in Figure 4 of the paper.

Thanks a lot!

[rayleizhu]

I will release the visualization demo notebook by the end of next month. If you need it right away, you can go ahead and implement it by yourself. It is not technically challenging, though there are many trivial routines.

See also #7 (comment)