Kobie Crawford

Jun 6, 2024 | databricks.com | Kobie Crawford |Jonathan Frankle |Ali Ghodsi |Naveen Rao

Businesses are making remarkable progress on their data and AI journeys. They’re advancing from a few pilot projects confined to use cases likely deemed “non-mission-critical,” to deploying applications in real-world operations across thousands of users that are enhancing employee productivity and improving efficiency. However, building and scaling these next-generation systems is a complex, resource-intensive combination of engineering challenges up and down the stack.

Dec 21, 2023 | databricks.com | Megha Agarwal |Kobie Crawford |Daya Khudia

The Databricks Mosaic R&D team launched the first iteration of our inference service architecture only seven months ago; since then, we’ve been making tremendous strides in delivering a scalable, modular, and performant platform that is ready to integrate every new advance in the fast-growing generative AI landscape. In January 2024, we will start using a new inference engine for serving Large Language Models (LLMs), built on NVIDIA TensorRT-LLM.