-
Jun 26, 2024 | 
thenewstack.io | Stephen Batifol |Jonathan Siddharth |Brian Wald |David Cassel
Using SPLADE to Generate Learned Sparse Embeddingssponsor-zilliz,sponsored-post-contributed, Image from Krot_Studio on ShutterstockThis is the second of two articles about learned sparse embeddings. Be sure to check out the previous installment on BGE-M3, which includes some critical background for understanding how the SPLADE model works. TL;DRVector databases rely on various embeddings to retrieve data and generate accurate output for users.
-
Jun 20, 2024 | 
thenewstack.io | Stephen Batifol |Ido Neeman |Susan Hall |Bruce Gain
Sometimes developers need to make a choice when it comes to LLM retrieval approaches. They can use a traditional sparse embedding or a dense embedding. Sparse embeddings work really well for keyword-matching processes. We typically find sparse embeddings in natural language processing (NLP), and these high-dimensional embeddings often contain zero values. The dimensions in these embeddings represent tokens across one (or multiple) language(s).
-
Jun 12, 2024 | 
thenewstack.io | Joab Jackson |Stephen Batifol |Heather Joslyn |Ben Chambers
For Spotify, speeding up feature development and deployment all comes down to templates and pipelines. The release cycle is almost completely automated. “The only people left in the process are developers,” said Tim Hansen, senior engineer, working on Backstage, at music-sharing service Spotify, speaking at this week’s PlatformCon 2024 virtual conference.
-
Jun 12, 2024 | 
thenewstack.io | Jeff James |Stephen Batifol |Heather Joslyn |Ben Chambers
Despite being a relative newcomer to the developer tools ecosystem, AI continues to have an increasingly significant impact on how developers are doing their jobs. According to a recent report by Gartner, 75% of enterprise software engineers will be using AI code assistants by 2028, a sizable jump from only 10% of those surveyed in 2023.
-
Jun 12, 2024 | 
thenewstack.io | Matt Butcher |Stephen Batifol |Heather Joslyn |Ben Chambers
This year Kubernetes celebrates its tenth birthday. As a developer who has been around the community since its early days, I found occasion to reflect on how things started, how Kubernetes marched to maturity, and how it is now displaying potential to expand into the WebAssembly movement. And since I’m a Swiftie, I broke these into eras in honor of my favorite musician. Era 1: When Kubernetes Was SimpleFirst, there was Borg.
-
Jun 12, 2024 | 
thenewstack.io | Darryl Taft |Stephen Batifol |Heather Joslyn |Ben Chambers
In a move to revolutionize the landscape of safety-critical software, The Rust Foundation has united key vendors — including Arm and Toyota — and experts to form the Safety-Critical Rust Consortium, paving the way for the adoption of the Rust programming language in systems where failure is not an option. Rust is not only one of the fastest-growing languages, it is also sought after for its memory safety, which the new consortium will help to proliferate.
-
Jun 10, 2024 | 
thenewstack.io | Susan Hall |Stephen Batifol |Heather Joslyn |Ben Chambers
In the microservices era, the amount of data generated for observability has become overwhelming. Organizations are wrestling with how much to store and how much they can toss in order to keep systems running and still bar the financial wolf from the door. For instance, TNS’ Loraine Lawson wrote about one company’s $65 million Datadog bill.
-
Jun 10, 2024 | 
thenewstack.io | Joab Jackson |Stephen Batifol |Heather Joslyn |Ben Chambers
SAN FRANCISCO — Last week, Snowflake announced it had adopted Apache Iceberg tables as a native format. Now customers can put their Snowflake data lakes into Iceberg, and even create external tables on a cloud provider of their choice, and have Snowflake manage them. In addition, Snowflake released Polaris, a catalog for Iceberg tables that could be called by any data processing engine that could read the format (Spark, Dremio, Snowflake).
-
Jun 10, 2024 | 
thenewstack.io | Andrew J. Brust |Stephen Batifol |Heather Joslyn |Ben Chambers
Many companies have their own API for programmatic access — numerous enterprise SaaS applications, hyper-scaler cloud services, and developer services like GitHub. But all of these APIs work differently, and they require imperative code in languages like Python, Java or C#.
-
Jun 9, 2024 | 
thenewstack.io | Guo Wei |Stephen Batifol |Heather Joslyn |Ben Chambers
When it comes to data integration, some people may wonder what there is to discuss— isn’t it just ETL? That is, extracting from various databases, transforming, and ultimately loading into different data warehouses. However, with the rise of big data, data lakes, real-time data warehouses, and large-scale models, the architecture of data integration has evolved from the ETL of the data warehouse era to the ELT of the big data era, and now to the current stage of EtLT.
