Multimodal Model
also: VLM · vision-language model
One model over several modalities — text, images, audio, video — in a shared token space.
A multimodal model encodes non-text inputs (image patches, audio frames) into the same token stream a language model reads, so one network can describe a photo, read a chart, or transcribe speech. Vision-language models (VLMs) power document AI and computer-use agents; the frontier is any-to-any — consuming and producing every modality natively.