Glossary

Mixture-of-Experts

A neural network architecture that routes each input to a small subset of specialized “expert” sub-networks rather than through the entire model, letting total parameter count scale without a proportional increase in compute per inference.

MoE

See Mixture-of-Experts.

multimodal

A model or system that can process and reason across more than one type of input — for example, text, images, audio, or video — rather than being limited to a single modality.