Keith Pijanowski

Featured in: Favicon

thenewstack.io Favicon

clouddatainsights.com

Articles

Model Checkpointing using Amazon’s S3 Connector for PyTorch and MinIO

Jan 17, 2025 | blog.min.io | Keith Pijanowski

Keith Pijanowski Keith Pijanowski on AI/ML | 17 January 2025 In November of 2023, Amazon announced the S3 Connector for PyTorch. The Amazon S3 Connector for PyTorch provides implementations of PyTorch's dataset primitives (Datasets and DataLoaders) that are purpose-built for S3 object storage. It supports map-style datasets for random data access patterns and iterable-style datasets for streaming sequential data access patterns.
The Architect’s Guide to Understanding Agentic AI

Jan 16, 2025 | startupnews.fyi | Keith Pijanowski

Often, while accessing the legitimacy of a new technology receiving a lot of hype, studying existing core capabilities and history is helpful. If the new technology in question is not based on existing or imminent capabilities, we can label it as hype and move on. Another litmus test that history can help us apply requires only common sense. Does the new technology fit an existing trend? Is it the next logical step in the direction of progress?
The Architect’s Guide to Understanding Agentic AI

Jan 16, 2025 | thenewstack.io | Keith Pijanowski

Often, while accessing the legitimacy of a new technology receiving a lot of hype, studying existing core capabilities and history is helpful. If the new technology in question is not based on existing or imminent capabilities, we can label it as hype and move on. Another litmus test that history can help us apply requires only common sense. Does the new technology fit an existing trend? Is it the next logical step in the direction of progress?
GPU Trends and What It Means to Your AI Infrastructure

Nov 27, 2024 | blog.min.io | Keith Pijanowski

Almost a year ago (actually 11 months ago), I wrote about the “Starving GPU Problem” and how the horsepower of Nvidia’s Graphic Processing Units (GPUs) could be so powerful that your network and your storage solution may not be able to keep up - preventing your expensive GPUs from being fully utilized. Well, in those short 11 months, a lot has changed. Nvidia announced a new chip architecture named after David Blackwell, a statistician and mathematician.
Revolutionizing Mobile Testing with Big Data and AI

Nov 21, 2024 | blog.min.io | Keith Pijanowski

A mobile application is a company's brand available on demand. It is a window into any service or product an organization offers. At Kobiton, they understand this—it is their mission to improve mobile applications through testing. Kobiton is a mobile testing platform that allows customers to perform manual and automated testing on real mobile devices from anywhere in the world. It started as a cloud service, but it recently utilized MinIO to provide an on-premises solution with AI features.
Map-Style Datasets using Amazon’s S3 Connector for PyTorch and MinIO

Oct 31, 2024 | blog.min.io | Keith Pijanowski

Before diving into Amazon’s S3 Connector for PyTorch, it is worthwhile to introduce the problem it is intended to solve. Many AI models need to be trained on data that cannot fit into memory. Furthermore, many really interesting models being built for computer vision and generative AI use data that cannot even fit on the disk drive that comes with a single server. Solving the storage problem is easy. If your dataset cannot fit on a single server, then you need S3-compatible object storage.
An Easier Path to Scalable AI: Intel Tiber Developer Cloud + MinIO Object Store

Oct 24, 2024 | blog.min.io | Keith Pijanowski

One of the biggest challenges facing organizations today for AI and data management is access to reliable infrastructure and compute resources. The Intel Tiber Developer Cloud is purpose-built for engineers who need an environment for proof-of-concepts, experimentation, model training, and service deployments. Unlike other clouds, which can be unapproachable and complex, the Intel Tiber Developer Cloud is simple and easy to use.
Replication, Data Consolidation, and Data Migration

Oct 24, 2024 | blog.min.io | Keith Pijanowski

Parsec Labs is a company of engineers. Most have designed storage systems, been responsible for backups and replication, or worked in networking building switches. Founded in 2013, their Unified Data Mobility and Protection Appliance provides the most straightforward tools for migrating, replicating, and backing up data at scale.
Microblink: Repatriating Compute and Storage with MinIO

Aug 29, 2024 | blog.min.io | Keith Pijanowski

Microblink is an AI company specializing in image detection. They got their start in the identity space with products like BlinkID, BlinkID Verify, and BlinkCard. Most recently, their image detection capabilities have led to products that can process other types of images. For example, product detection can be performed on receipts, whereby product descriptions on a receipt are used to lookup product SKUs and other details. Below is a full list and description of Microblink’s products.
Open Source or Closed? The AI Dilemma

Jul 29, 2024 | thenewstack.io | Keith Pijanowski |Siddarth Jain |Patrick McFadin |Alex Williams

Artificial intelligence is in the middle of a perfect storm in the software industry, and now Mark Zuckerberg is calling for open sourced AI. Three powerful perspectives are colliding on how to control AI:All AI should be open source for sharing and transparency. Keep AI closed-source and allow big tech companies to control it. Establish regulations for the use of AI. There are a few facts that make this debate tricky.