Ankit Mathur

Oct 30, 2024 | databricks.com | Ahmed Bilal |Youngbin Kim |Ankit Mathur |Kasey Uhlenhuth

When serving machine learning models, the latency between requesting a prediction and receiving a response is one of the most critical metrics for the end user. Latency includes the time a request takes to reach the endpoint, be processed by the model, and then return to the user. Serving models to users that are based in a different region can significantly increase both the request and response times.

Oct 22, 2024 | databricks.com | Ahmed Bilal |Youngbin Kim |Ankit Mathur |Daniel King

Over the years, organizations have amassed a vast amount of unstructured text data—documents, reports, and emails—but extracting meaningful insights has remained a challenge. Large Language Models (LLMs) now offer a scalable way to analyze this data, with batch inference as the most efficient solution. However, many tools still focus on online inference, leaving a gap for better batch processing capabilities.

Jul 23, 2024 | databricks.com | Ahmed Bilal |Ankit Mathur |Hanlin Tang |Patrick Wendell

We are excited to partner with Meta to release the Llama 3.1 series of models on Databricks, further advancing the standard of powerful open models. With Llama 3.1, enterprises can now build the highest-quality GenAI apps without sacrificing ownership and customization for quality.

May 6, 2024 | onlinelibrary.wiley.com | Ankit Mathur |Santanu Chakraborty |Soumee Banerjee |Neha Hurkat

DATA AVAILABILITY STATEMENT All data supporting the findings of this study are available within the paper and its Supplementary Information. The complete list of reported mutations leading to Rh null phenotypes are available in International Society of Blood Transfusion. Table of Blood Group Systems v 6.0_6th August 2019. http://isbtweb.org/working-parties/redcell-immunogenetics-and-blood-group-terminology/.

Apr 16, 2024 | ossna2024.sched.com | Ankit Mathur

Ankit MathurStaff Software Engineer, DatabricksI work on ML Infrastructure here at Databricks, and I currently tech lead our model serving efforts. Our team launched the Foundation Model API service at Databricks and is helping enterprises move LLMs into production. Previously, I've worked on a wide variety of ML at Databricks... Read More →Denny LeeSr. Staff Developer Advocate, DatabricksDenny Lee is a Sr. Staff Developer Advocate at Databricks.