Zebra: Extending context window with layerwise grouped local-global attention

Published in arXiv preprint arXiv:2312.08618, 2023

Use Google Scholar for full citation

Recommended citation: Kaiqiang Song, Xiaoyang Wang, Sangwoo Cho, Xiaoman Pan, Dong Yu, "Zebra: Extending context window with layerwise grouped local-global attention." arXiv preprint arXiv:2312.08618, 2023.