MixFormer (Microsoft’s Phi Architecture)
See “Textbooks Are All You Need II: phi-1.5 technical report”, Lin et al. 2023