Yan Chang

Sep 28, 2024 | therobotreport.com | Abrar Anwar |Josh Welsh |Yan Chang |Brianna Wessling

Vision-language models, or VLMs, combine the powerful language understanding of foundational large language models with the vision capabilities of vision transformers (ViTs) by projecting text and images into the same embedding space. They can take unstructured multimodal data, reason over it, and return the output in a structured format.

Sep 23, 2024 | developer.nvidia.com | Abrar Anwar |John Welsh |Yan Chang

Vision-language models (VLMs) combine the powerful language understanding of foundational LLMs with the vision capabilities of vision transformers (ViTs) by projecting text and images into the same embedding space. They can take unstructured multimodal data, reason over it, and return the output in a structured format. Building on a broad base of pretraining, they can be easily adapted for different vision-related tasks by providing new prompts or parameter-efficient fine-tuning.

Sep 20, 2024 | arxiv.org | John Welsh |Joydeep Biswas |Yan Chang |Soha Pouya