Daya Khudia

Mar 26, 2024 | databricks.com | Jeffrey Chen |Megha Agarwal |Margaret Qian |Daya Khudia

IntroductionAfter a whirlwind year of developments in 2023, many enterprises are eager to adopt increasingly capable generative AI models to supercharge their businesses. An essential component of this push requires the ability to query state-of-the-art large language models and incorporate them into existing enterprise workstreams.

Dec 21, 2023 | databricks.com | Megha Agarwal |Kobie Crawford |Daya Khudia

The Databricks Mosaic R&D team launched the first iteration of our inference service architecture only seven months ago; since then, we’ve been making tremendous strides in delivering a scalable, modular, and performant platform that is ready to integrate every new advance in the fast-growing generative AI landscape. In January 2024, we will start using a new inference engine for serving Large Language Models (LLMs), built on NVIDIA TensorRT-LLM.