Tagged
AI·3 November 2026·4 min read
A mixture of experts model uses a router to send each token to a few specialist sub-networks, so a huge model runs only part of itself at a time.