Atlas / Reports / Detail
EMO: Pretraining Mixture of Experts for Emergent Modularity
Mixture-of-Experts Language Models report from Ai2 with 3 connected researchers in the LLMpeople atlas.
Connected researchers
Researcher
5 reports
Akshita Bhagia
Ai2
Research scientist at Ai2 and PhD candidate at the University of Washington. Her work focuses on language models, evaluation, and building practical open-source AI systems.
Researcher
1 reports
Ryan Wang
Ai2
Researcher at Ai2 and coauthor of the EMO: Pretraining Mixture of Experts for Emergent Modularity.
Researcher
3 reports
Sewon Min
Ai2
Assistant professor at the University of California, Berkeley and research scientist at the Allen Institute for AI. Her public homepage highlights work on language models, natural language processing, pretraining, post-training, and test-time computation.