datacentre.solutions Open in urlscan Pro
2606:4700:3030::ac43:c07e  Public Scan

Submitted URL: https://marketing-email.supermicro.com/e3t/Ctc/2L+113/cPmn004/VW9mM97HXlChW46c1s312068_W1xTZ7Q5812bZN4Tr4Mq5nR32W5BWr2F6lZ3n4N5MxdssQWt...
Effective URL: https://datacentre.solutions/blog/57760/ai-workloads-pose-new-challenges-to-your-storage-infrastructure?utm_campaign=Monthly%...
Submission: On January 09 via api from ES — Scanned from ES

Form analysis 0 forms found in the DOM

Text Content

Datacentre Solutions uses cookies to ensure you get the best experience on our
website. Read our privacy policy
Okay, thanks!

We would like to keep you up to date with the latest news from Datacentre
Solutions by sending you push notifications.

Decline Accept


SUBSCRIBE TO DATA CENTRE SOLUTIONS

×
Your Name
Email Address
Company Name
Job Title
Industry Please Select Aerospace/defence Architecture/construction Automotive
Education Health/medical Healthcare/pharmaceutical Central/local government
Finance/banking/insurance Travel/hospitality/leisure Legal Manufacturing
Media/broadcasting Public services Retail Ecommerce Transportation Utilities
Other Hardware or Software manufacturer Consultancy Data centre design & build
Distributor Reseller / VAR / Systems Integrator Software developer Service
provider - Telco, Cloud or Managed Training Other
Country Please Select Afghanistan Åland Islands Albania Algeria American Samoa
Andorra Angola Anguilla Antarctica Antigua and Barbuda Argentina Armenia Aruba
Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium
Belize Benin Bermuda Bhutan Bolivia, Plurinational State of Bonaire, Sint
Eustatius and Saba Bosnia and Herzegovina Botswana Bouvet Island Brazil British
Indian Ocean Territory Brunei Darussalam Bulgaria Burkina Faso Burundi Cambodia
Cameroon Canada Cape Verde Cayman Islands Central African Republic Chad Chile
China Christmas Island Cocos (Keeling) Islands Colombia Comoros Congo Congo, the
Democratic Republic of the Cook Islands Costa Rica Côte d'Ivoire Croatia Cuba
Curaçao Cyprus Czech Republic Denmark Djibouti Dominica Dominican Republic
Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Ethiopia Falkland
Islands (Malvinas) Faroe Islands Fiji Finland France French Guiana French
Polynesia French Southern Territories Gabon Gambia Georgia Germany Ghana
Gibraltar Greece Greenland Grenada Guadeloupe Guam Guatemala Guernsey Guinea
Guinea-Bissau Guyana Haiti Heard Island and McDonald Islands Holy See (Vatican
City State) Honduras Hong Kong Hungary Iceland India Indonesia Iran, Islamic
Republic of Iraq Ireland Isle of Man Israel Italy Jamaica Japan Jersey Jordan
Kazakhstan Kenya Kiribati Korea, Democratic People's Republic of Korea, Republic
of Kuwait Kyrgyzstan Lao People's Democratic Republic Latvia Lebanon Lesotho
Liberia Libya Liechtenstein Lithuania Luxembourg Macao Macedonia, the former
Yugoslav Republic of Madagascar Malawi Malaysia Maldives Mali Malta Marshall
Islands Martinique Mauritania Mauritius Mayotte Mexico Micronesia, Federated
States of Moldova, Republic of Monaco Mongolia Montenegro Montserrat Morocco
Mozambique Myanmar Namibia Nauru Nepal Netherlands New Caledonia New Zealand
Nicaragua Niger Nigeria Niue Norfolk Island Northern Mariana Islands Norway Oman
Pakistan Palau Palestinian Territory, Occupied Panama Papua New Guinea Paraguay
Peru Philippines Pitcairn Poland Portugal Puerto Rico Qatar Réunion Romania
Russian Federation Rwanda Saint Barthélemy Saint Helena, Ascension and Tristan
da Cunha Saint Kitts and Nevis Saint Lucia Saint Martin (French part) Saint
Pierre and Miquelon Saint Vincent and the Grenadines Samoa San Marino Sao Tome
and Principe Saudi Arabia Senegal Serbia Seychelles Sierra Leone Singapore Sint
Maarten (Dutch part) Slovakia Slovenia Solomon Islands Somalia South Africa
South Georgia and the South Sandwich Islands South Sudan Spain Sri Lanka Sudan
Suriname Svalbard and Jan Mayen Swaziland Sweden Switzerland Syrian Arab
Republic Taiwan, Province of China Tajikistan Tanzania, United Republic of
Thailand Timor-Leste Togo Tokelau Tonga Trinidad and Tobago Tunisia Turkey
Turkmenistan Turks and Caicos Islands Tuvalu Uganda Ukraine United Arab Emirates
United Kingdom United States United States Minor Outlying Islands Uruguay
Uzbekistan Vanuatu Venezuela, Bolivarian Republic of Viet Nam Virgin Islands,
British Virgin Islands, U.S. Wallis and Futuna Western Sahara Yemen Zambia
Zimbabwe
Choose Subscriptions
Data Centre Solutions Magazines
Data Centre Solutions Digital Newsletter

If you want to receive relevant information from carefully selected 3rd parties
via our publications, please check this box.
I accept the terms and conditions and privacy policy.
Subscribe



WHY SUBSCRIBE?

Digital Newsletter
Each week our editor Phil Alsop rounds up the most popular articles, videos and
expert opinions. We compile this into a Digital Newsletter and send it straight
to your inbox every week.

Digital Magazines
We'll let you know each time a new edition of Data Centre Solutions is released
so that you're always kept up-to-date with the latest and greatest news and
press releases.

Video Magazines
The Data Centre Solutions Video magazine contains the latest Zoom interviews
with experts in the industry.

Open Menu Close Menu
 * News
   All News Cloud Design + Optimisation Energy Management Hosting + Colocation
   Infrastructure + Asset Management Infrastructure + Hardware Power & Cooling
 * Videos
   All Videos Cloud Design + Optimisation Energy Management Hosting + Colocation
   Infrastructure + Asset Management Infrastructure + Hardware Power & Cooling
 * Technology Spotlights
   All Technology Spotlights Cloud Design + Optimisation Energy Management
   Hosting + Colocation Infrastructure + Asset Management Infrastructure +
   Hardware Power & Cooling
 * Magazine
 * Events
   Event Directory Managed Services Summit AI Transform
 * Awards
   DCS Awards SDC Awards
 * Advertise
 * 
 * 
 * Search
 * About
 * Contact

 * 

 * Subscribe
 * About
 * Contact


 * Cloud
   News Videos Technology Spotlights
 * Design + Optimisation
   News Videos Technology Spotlights
 * Energy Management
   News Videos Technology Spotlights
 * Hosting + Colocation
   News Videos Technology Spotlights
 * Infrastructure + Asset Management
   News Videos Technology Spotlights
 * Infrastructure + Hardware
   News Videos Technology Spotlights
 * Power & Cooling
   News Videos Technology Spotlights
 * Quantum Computing
   News Videos Technology Spotlights


AI WORKLOADS POSE NEW CHALLENGES TO YOUR STORAGE INFRASTRUCTURE


BY MICHAEL MCNERNEY, VICE PRESIDENT MARKETING AND NETWORK SECURITY, SUPERMICRO.

 * 1 month ago Posted in

There’s a complete makeover underway in modern enterprises today. It’s centered
around what might be called the “AI revolution.” Organizations are obtaining
competitive advantages and key insights when they put advanced AI- or ML-based
applications to work.


Among the leading examples of such workloads are large language models (LLMs)
such as ChatGPT along with ML models based on humongous training data sets,
complex 3D models, animation and virtual reality, simulations, and other data-
and compute-intensive applications.

For a high performance AI or ML solution, an entire, comprehensive set of
hardware needs to be working together. Behind the flashy rack-mounted hardware
that houses the GPU-driven brains of any AI cluster, high throughput,
low-latency storage systems are needed to keep the cluster productive. These
support the I/O channels feeding massive amounts of data to train models and
perform complex simulations and analyses needed to support AI, ML, and similar
workloads. Indeed, one of the biggest challenges facing businesses looking to
capitalize on the growth of AI is finding a storage solution that won’t
bottleneck their high-performance CPUs, GPUs, or database clusters. After all,
the CPUs and GPUs need to be kept busy to reduce the TCO of the data center.

Avoiding storage bottlenecks

What happens in distributed and parallel modes is that for the distributed file
systems, data arrives from multiple sources where that data needs to get
processed at scale across various protocols and for various applications. In a
typical storage system, metadata quickly becomes a bottleneck. Indeed, you can
only pump as much data through the system as the metadata supports. As the
amount of data scales, the ability to handle metadata needs to scale
proportionally.

WEKA distributed storage is architected to provide such proportional scaling.
That explains why, despite adding more data capacity to a system or cluster, the
I/O performance continues to scale linearly from eight (minimum node count for a
WEKA cluster) to hundreds of storage nodes. It does so by eliminating
bottlenecks and providing support for even the heaviest and most demanding AI/ML
(and other similar) workloads.

But there’s more to optimizing servers and clusters than providing scalable,
high-performance, low-latency storage. When designing an entire system, the
focus cannot be exclusively on any single feature or function. The entire
architecture must work in concert to support targeted workloads. Thus, designing
a system for AI applications means creating a runtime environment built from the
ground up to handle data-intensive applications both quickly and satisfactorily.
What the server does with the data while handling an AI workload is as essential
as the data traffic into and out of any given node.

NVMe to the rescue

Another critical feature is the number of PCIe 5.0 lanes. This technology
enables servers to accommodate more extensive collections of SSDs, NICs, GPUs,
and even extended memory CXL devices. All of these play essential roles in
handling demanding AI and ML workloads, including PCIe Gen5 SSDs for high-speed
local storage, large numbers of high-speed network interfaces to connect servers
to other nodes, such as storage or other specialized servers, to extend data
scope and reach as well as large numbers of GPUs for handling specialized,
targeted tasks or workloads.

NVMe devices have totally changed the server and cluster game. With NVMe at its
base, a completely reworked architecture becomes possible. It allows storage to
work at scale and speed alongside high-performance CPUs, GPUs, and NICs,
especially with the EDSFF form factor. Single-socket design enables
best-of-breed CPUs to fully saturate network cards and storage and exploit the
highest possible levels of parallelism and clustering capabilities for HPC, AI,
and other next-generation solutions.

Share this article:
Linkedin Twitter Facebook Email


AI AND DATA CENTRES - WHY AI IS SO RESOURCE HUNGRY

By Ed Ansett, Founder and Chairman, i3 Solutions Group.


AI STRATEGIES: LEARNING FROM THE LAST ‘GOLD RUSH’ TO CLOUD

By Chris Jackson, Chief Product and Technology Officer at Six Degrees.


HOW ECOMMERCE AND FINTECH FIRMS ARE LEVERAGING THE TRANSFORMATIVE POWER OF
AI-ENABLED DATA CENTRES

Andy Connor, EMEA Channel Director at Subzero Engineering, examines the impact
AI, blockchain and process automation is having on the eCommerce and fintech
sectors.


AI – AN INDUSTRY SNAPSHOT

By James Carmillet, Director of Cost Management at BCS.



THE AI BURDEN WILL BE MET BY DATACENTRES. CAN THEY COPE?

By Nicholas Cole, Data Centre Solution Manager, EXFO.


MASTER AI BEFORE AI MASTERS YOUR BUSINESS

By Michael Deheneffe, Director Marketing & Innovation at Orange Business
Services, Digital & Data.


THE EMPOWERING ROLE OF AI IN MARKETING

By Jess Petrella, Director of Product Marketing at Unbounce.


COULD EDGE COMPUTING UNLOCK AI’S VAST POTENTIAL?

By Wayne Carter, VP Engineering, Couchbase.


ABOUT US

Datacentre Solutions is, quite simply, the most comprehensive, leading
information resource covering the key technologies that underpin the digital
revolution.

Call Us: +44 (0) 2476 718 970

Email Us: hello@datacentre.solutions

QUICK LINKS

 * About Us
 * Privacy Policy
 * Terms & Conditions
 * The Publishers

SOCIAL

 * Twitter
 * Linkedin

OUR OTHER PUBLICATIONS AND EVENTS




© 2024 - Angel Business Communications Limited

Made with by Angels