-
Dec 2, 2024 | 
bigdatawire.com | Alex Woodie |Anais Dotis-Georgiou
We are now in an era where large foundation models (large-scale, general-purpose neural networks pre-trained in an unsupervised manner on large amounts of diverse data) are transforming fields like computer vision, natural language processing, and, more recently, time-series forecasting. These models are reshaping time series forecasting by enabling zero-shot forecasting, allowing predictions on new, unseen data without retraining for each dataset.
-
Aug 29, 2024 | 
influxdata.com | Anais Dotis-Georgiou
In a previous post, we described a CSTR and a PID controller. This post will cover the code and architecture of the digital twin from this project repo. The project leverages Kafka for data streaming, Faust for data processing, InfluxDB for storing the time series data, and Telegraf for writing data from the topic to InfluxDB. We’ll also cover the advantages and disadvantages of this stack. The corresponding repo for this blog post can be found here.
-
Aug 27, 2024 | 
influxdata.com | Anais Dotis-Georgiou
In the fast-evolving chemical industry, maintaining precise control over Chemical reactors like a continuous stirred-tank reactor (CSTRs) is paramount to ensuring optimal performance and product quality. This blog post delves into integrating advanced data tools and techniques to achieve this control. We’ll explore how to leverage InfluxDB, Kafka, and Faust streaming, along with Telegraf, to effectively model and manage a CSTR and its PID controller (Proportional-Integral-Derivative Controller).
-
Aug 20, 2024 | 
thenewstack.io | Anais Dotis Georgiou |Anais Dotis-Georgiou |Loraine Lawson |Avitan Gefen
It’s no secret that the rise of large language models (LLMs) like ChatGPT and Bard has dramatically changed how many work, communicate, and learn. But LLMs have applications other than replacing search engines. Most recently, data scientists have repurposed LLMs for time series forecasting. Time series data is ubiquitous across domains, from financial markets to climate science.
-
Apr 11, 2024 | 
flipboard.com | Anais Dotis-Georgiou
Electric Vehicles1 hour ago$45K EV smuggles a 620-mile solid-state battery out of the labnewatlas.com - By C.C. Weiss • 1hIM motors has decided that semi solid-state batteries are ready for prime time.
-
Apr 11, 2024 | 
infoworld.com | Anais Dotis-Georgiou
The Apache Software Foundation develops and maintains open source software projects that significantly impact various domains of computing, from web servers and databases to big data and machine learning. As the volume and velocity of time series data continue to grow, thanks to IoT devices, AI, financial systems, and monitoring tools, more and more companies will rely on the Apache ecosystem to manage and analyze this kind of data.
-
Feb 22, 2024 | 
dzone.com | Anais Dotis-Georgiou
Telegraf is an open-source server agent designed for collecting, processing, aggregating, and writing metrics. Developed by InfluxData, it is part of the InfluxDB time series database platform. Known for its simplicity and ease of use, Telegraf offers a plug-and-play architecture with an array of input, output, and processor plugins.
-
Dec 20, 2023 | 
dzone.com | Anais Dotis-Georgiou
Arrow Flight is a “new general-purpose client-server framework to simplify high-performance transport of large datasets over network interfaces.” Flight uses gRPC and IPC protocols as its foundation. The structure of Flight primarily focuses on the transmission of Arrow record batches. The protocols for transmitting methods and data use Protobuf outlines, providing compatibility with clients equipped to handle gRPC and Arrow individually, even if they do not support Flight directly.
-
Nov 20, 2023 | 
infoworld.com | Anais Dotis-Georgiou
Historically, working with big data has been quite a challenge. Companies that wanted to tap big data sets faced significant performance overhead relating to data processing. Specifically, moving data between different tools and systems required leveraging different programming languages, network protocols, and file formats. Converting this data at each step in the data pipeline was costly and inefficient.
-
Nov 16, 2023 | 
dzone.com | Anais Dotis-Georgiou
Apache Arrow Flight SQL is “a new client-server protocol developed by the Apache Arrow community for interacting with SQL databases that makes use of the Arrow in-memory columnar format and the Flight RPC framework.” In this article, we’ll explore some of the advantages of Arrow Flight SQL, as well as how to read table metadata from an SQL database. Reading table metadata from an SQL database is crucial for several reasons.
