November 18, 2018
Internet of Things

The Voracious Appetites of Machine Learning & Artificial Intelligence

‍

Like the Internet of Things, machine learning (ML) and its more august sibling, artificial intelligence (AI), are upon us. The former is impacting business and IT operations, and the latter will impact nearly all of society. When most of us think of them, we envision incomprehensible algorithms and the brawny CPUs and GPUs all but running on nitro that bring them to life. Who thinks of quotidian storage?

The fact is the very foundation of AI and ML is data, lots of it, and the data must be stored somewhere. The data coming out of AI and ML are only as good as the data going into them. And the more data, the better. The larger the datasets, the more accurate will be the pattern recognition, correlations, analyses, and decision-making. The more data, the smarter our machines will be. This is true for any use case or workload, from sequencing genomes, improving agricultural yields, and scientific research to fraud detection, customer support, and self-driving automobiles.

Additionally, AI and ML generate data. Once AI/ML applications process their source data, the results will need to be safely stored and reused for further analyses.

Feeding the gluttony of AI and ML for data presents challenges. Data will come from many sources, such as business operations within the enterprise and IoT and social media from outside the enterprise. Data repositories must be extremely scalable, while still being cost-efficient, which often means hybrid infrastructures combining on-premise and cloud storage. Object storage will be a common solution for its ability to present vast troves of data in a single namespace.

Additionally, using high-octane GPUs will be wasted if the storage is a bottleneck. For this reason, AI and ML can best be served by flash drives, particularly for real-time use cases like assessing financial transactions.

Finally, AI and ML will improve storage itself. Vendors have already started to include logic in their offerings to better understand and manage enterprise environments. Armed with AI and ML, administrators will determine usage and detect patterns, and make more informed decisions about I/O patterns and data lifecycles. They’ll more accurately project future capacity needs and even perhaps predict failures, permitting proactive measures to safeguard operations.

The bottom line: if you’re planning on ML or AI applications in your enterprise, strongly consider the storage that will enable them. In storage, as in life itself, the one thing that never changes is that things are always changing.

Author:

Keep Reading

Latest Updates

Jul 24, 2015

RAID Levels & Fault Tolerance

RAID levels impact fault tolerance and performance. Find out how different configurations affect data security and storage efficiency in modern systems.

Jul 24, 2015
Apr 01, 2016

What is Erasure Coding and When Should it Be Used?

Erasure coding provides advanced, scalable data protection, surpassing RAID in distributed environments. Find out how to choose the best strategy for your needs.

Apr 01, 2016
Jun 12, 2017

HDD vs SSD Storage

Discover how SSDs outperform traditional HDDs in speed, efficiency, and cost-effectiveness, and why hybrid solutions might be the key for your storage needs.

Jun 12, 2017
Sep 10, 2013

Hadoop & Big Data Analysis

Learn how Apache Hadoop transforms big data analysis with distributed processing, scalability, and cost-effective solutions for modern enterprises.

Sep 10, 2013
Nov 18, 2024

JetStor Partners with Heros Technology and QSAN to Expand Presence in Latin America

JetStor has partnered with Heros Technology and QSAN to expand its presence in Latin America, enhancing storage solutions with Heros as a Value-Added Reseller

Nov 18, 2024
Nov 20, 2025

JetStor Founder on Innovation, Grit, and Investing with Driven: Unscripted Success

JetStor founder and “Data Storage Guru” Gene Leyzarovich joins the Driven: Unscripted Success podcast to share how he bootstrapped RAID systems out of an apartment, stayed debt free for three decades, and built a global storage business while investing beyond tech.

Nov 20, 2025
Contact and let us create a custom solution for you
An experienced JetStor systems engineer will assist you in translating your application requirements into specifications for system internal bandwidth, host(s) bandwidth, read and write performance, availability, redundancy and rack space.  From those specifications, a purpose-designed JetStor storage solution is crafted that addresses both your current needs as well as the future scalability required for the longest useful life and highest return on investment.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.