datacentre.solutions
Open in
urlscan Pro
2606:4700:3030::ac43:c07e
Public Scan
Submitted URL: https://marketing-email.supermicro.com/e3t/Ctc/2L+113/cPmn004/VW9mM97HXlChW46c1s312068_W1xTZ7Q5812bZN4Tr4Mq5nR32W5BWr2F6lZ3n4N5MxdssQWt...
Effective URL: https://datacentre.solutions/blog/57760/ai-workloads-pose-new-challenges-to-your-storage-infrastructure?utm_campaign=Monthly%...
Submission: On January 09 via api from ES — Scanned from ES
Effective URL: https://datacentre.solutions/blog/57760/ai-workloads-pose-new-challenges-to-your-storage-infrastructure?utm_campaign=Monthly%...
Submission: On January 09 via api from ES — Scanned from ES
Form analysis
0 forms found in the DOMText Content
Datacentre Solutions uses cookies to ensure you get the best experience on our website. Read our privacy policy Okay, thanks! We would like to keep you up to date with the latest news from Datacentre Solutions by sending you push notifications. Decline Accept SUBSCRIBE TO DATA CENTRE SOLUTIONS × Your Name Email Address Company Name Job Title Industry Please Select Aerospace/defence Architecture/construction Automotive Education Health/medical Healthcare/pharmaceutical Central/local government Finance/banking/insurance Travel/hospitality/leisure Legal Manufacturing Media/broadcasting Public services Retail Ecommerce Transportation Utilities Other Hardware or Software manufacturer Consultancy Data centre design & build Distributor Reseller / VAR / Systems Integrator Software developer Service provider - Telco, Cloud or Managed Training Other Country Please Select Afghanistan Åland Islands Albania Algeria American Samoa Andorra Angola Anguilla Antarctica Antigua and Barbuda Argentina Armenia Aruba Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bermuda Bhutan Bolivia, Plurinational State of Bonaire, Sint Eustatius and Saba Bosnia and Herzegovina Botswana Bouvet Island Brazil British Indian Ocean Territory Brunei Darussalam Bulgaria Burkina Faso Burundi Cambodia Cameroon Canada Cape Verde Cayman Islands Central African Republic Chad Chile China Christmas Island Cocos (Keeling) Islands Colombia Comoros Congo Congo, the Democratic Republic of the Cook Islands Costa Rica Côte d'Ivoire Croatia Cuba Curaçao Cyprus Czech Republic Denmark Djibouti Dominica Dominican Republic Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Ethiopia Falkland Islands (Malvinas) Faroe Islands Fiji Finland France French Guiana French Polynesia French Southern Territories Gabon Gambia Georgia Germany Ghana Gibraltar Greece Greenland Grenada Guadeloupe Guam Guatemala Guernsey Guinea Guinea-Bissau Guyana Haiti Heard Island and McDonald Islands Holy See (Vatican City State) Honduras Hong Kong Hungary Iceland India Indonesia Iran, Islamic Republic of Iraq Ireland Isle of Man Israel Italy Jamaica Japan Jersey Jordan Kazakhstan Kenya Kiribati Korea, Democratic People's Republic of Korea, Republic of Kuwait Kyrgyzstan Lao People's Democratic Republic Latvia Lebanon Lesotho Liberia Libya Liechtenstein Lithuania Luxembourg Macao Macedonia, the former Yugoslav Republic of Madagascar Malawi Malaysia Maldives Mali Malta Marshall Islands Martinique Mauritania Mauritius Mayotte Mexico Micronesia, Federated States of Moldova, Republic of Monaco Mongolia Montenegro Montserrat Morocco Mozambique Myanmar Namibia Nauru Nepal Netherlands New Caledonia New Zealand Nicaragua Niger Nigeria Niue Norfolk Island Northern Mariana Islands Norway Oman Pakistan Palau Palestinian Territory, Occupied Panama Papua New Guinea Paraguay Peru Philippines Pitcairn Poland Portugal Puerto Rico Qatar Réunion Romania Russian Federation Rwanda Saint Barthélemy Saint Helena, Ascension and Tristan da Cunha Saint Kitts and Nevis Saint Lucia Saint Martin (French part) Saint Pierre and Miquelon Saint Vincent and the Grenadines Samoa San Marino Sao Tome and Principe Saudi Arabia Senegal Serbia Seychelles Sierra Leone Singapore Sint Maarten (Dutch part) Slovakia Slovenia Solomon Islands Somalia South Africa South Georgia and the South Sandwich Islands South Sudan Spain Sri Lanka Sudan Suriname Svalbard and Jan Mayen Swaziland Sweden Switzerland Syrian Arab Republic Taiwan, Province of China Tajikistan Tanzania, United Republic of Thailand Timor-Leste Togo Tokelau Tonga Trinidad and Tobago Tunisia Turkey Turkmenistan Turks and Caicos Islands Tuvalu Uganda Ukraine United Arab Emirates United Kingdom United States United States Minor Outlying Islands Uruguay Uzbekistan Vanuatu Venezuela, Bolivarian Republic of Viet Nam Virgin Islands, British Virgin Islands, U.S. Wallis and Futuna Western Sahara Yemen Zambia Zimbabwe Choose Subscriptions Data Centre Solutions Magazines Data Centre Solutions Digital Newsletter If you want to receive relevant information from carefully selected 3rd parties via our publications, please check this box. I accept the terms and conditions and privacy policy. Subscribe WHY SUBSCRIBE? Digital Newsletter Each week our editor Phil Alsop rounds up the most popular articles, videos and expert opinions. We compile this into a Digital Newsletter and send it straight to your inbox every week. Digital Magazines We'll let you know each time a new edition of Data Centre Solutions is released so that you're always kept up-to-date with the latest and greatest news and press releases. Video Magazines The Data Centre Solutions Video magazine contains the latest Zoom interviews with experts in the industry. Open Menu Close Menu * News All News Cloud Design + Optimisation Energy Management Hosting + Colocation Infrastructure + Asset Management Infrastructure + Hardware Power & Cooling * Videos All Videos Cloud Design + Optimisation Energy Management Hosting + Colocation Infrastructure + Asset Management Infrastructure + Hardware Power & Cooling * Technology Spotlights All Technology Spotlights Cloud Design + Optimisation Energy Management Hosting + Colocation Infrastructure + Asset Management Infrastructure + Hardware Power & Cooling * Magazine * Events Event Directory Managed Services Summit AI Transform * Awards DCS Awards SDC Awards * Advertise * * * Search * About * Contact * * Subscribe * About * Contact * Cloud News Videos Technology Spotlights * Design + Optimisation News Videos Technology Spotlights * Energy Management News Videos Technology Spotlights * Hosting + Colocation News Videos Technology Spotlights * Infrastructure + Asset Management News Videos Technology Spotlights * Infrastructure + Hardware News Videos Technology Spotlights * Power & Cooling News Videos Technology Spotlights * Quantum Computing News Videos Technology Spotlights AI WORKLOADS POSE NEW CHALLENGES TO YOUR STORAGE INFRASTRUCTURE BY MICHAEL MCNERNEY, VICE PRESIDENT MARKETING AND NETWORK SECURITY, SUPERMICRO. * 1 month ago Posted in There’s a complete makeover underway in modern enterprises today. It’s centered around what might be called the “AI revolution.” Organizations are obtaining competitive advantages and key insights when they put advanced AI- or ML-based applications to work. Among the leading examples of such workloads are large language models (LLMs) such as ChatGPT along with ML models based on humongous training data sets, complex 3D models, animation and virtual reality, simulations, and other data- and compute-intensive applications. For a high performance AI or ML solution, an entire, comprehensive set of hardware needs to be working together. Behind the flashy rack-mounted hardware that houses the GPU-driven brains of any AI cluster, high throughput, low-latency storage systems are needed to keep the cluster productive. These support the I/O channels feeding massive amounts of data to train models and perform complex simulations and analyses needed to support AI, ML, and similar workloads. Indeed, one of the biggest challenges facing businesses looking to capitalize on the growth of AI is finding a storage solution that won’t bottleneck their high-performance CPUs, GPUs, or database clusters. After all, the CPUs and GPUs need to be kept busy to reduce the TCO of the data center. Avoiding storage bottlenecks What happens in distributed and parallel modes is that for the distributed file systems, data arrives from multiple sources where that data needs to get processed at scale across various protocols and for various applications. In a typical storage system, metadata quickly becomes a bottleneck. Indeed, you can only pump as much data through the system as the metadata supports. As the amount of data scales, the ability to handle metadata needs to scale proportionally. WEKA distributed storage is architected to provide such proportional scaling. That explains why, despite adding more data capacity to a system or cluster, the I/O performance continues to scale linearly from eight (minimum node count for a WEKA cluster) to hundreds of storage nodes. It does so by eliminating bottlenecks and providing support for even the heaviest and most demanding AI/ML (and other similar) workloads. But there’s more to optimizing servers and clusters than providing scalable, high-performance, low-latency storage. When designing an entire system, the focus cannot be exclusively on any single feature or function. The entire architecture must work in concert to support targeted workloads. Thus, designing a system for AI applications means creating a runtime environment built from the ground up to handle data-intensive applications both quickly and satisfactorily. What the server does with the data while handling an AI workload is as essential as the data traffic into and out of any given node. NVMe to the rescue Another critical feature is the number of PCIe 5.0 lanes. This technology enables servers to accommodate more extensive collections of SSDs, NICs, GPUs, and even extended memory CXL devices. All of these play essential roles in handling demanding AI and ML workloads, including PCIe Gen5 SSDs for high-speed local storage, large numbers of high-speed network interfaces to connect servers to other nodes, such as storage or other specialized servers, to extend data scope and reach as well as large numbers of GPUs for handling specialized, targeted tasks or workloads. NVMe devices have totally changed the server and cluster game. With NVMe at its base, a completely reworked architecture becomes possible. It allows storage to work at scale and speed alongside high-performance CPUs, GPUs, and NICs, especially with the EDSFF form factor. Single-socket design enables best-of-breed CPUs to fully saturate network cards and storage and exploit the highest possible levels of parallelism and clustering capabilities for HPC, AI, and other next-generation solutions. Share this article: Linkedin Twitter Facebook Email AI AND DATA CENTRES - WHY AI IS SO RESOURCE HUNGRY By Ed Ansett, Founder and Chairman, i3 Solutions Group. AI STRATEGIES: LEARNING FROM THE LAST ‘GOLD RUSH’ TO CLOUD By Chris Jackson, Chief Product and Technology Officer at Six Degrees. HOW ECOMMERCE AND FINTECH FIRMS ARE LEVERAGING THE TRANSFORMATIVE POWER OF AI-ENABLED DATA CENTRES Andy Connor, EMEA Channel Director at Subzero Engineering, examines the impact AI, blockchain and process automation is having on the eCommerce and fintech sectors. AI – AN INDUSTRY SNAPSHOT By James Carmillet, Director of Cost Management at BCS. THE AI BURDEN WILL BE MET BY DATACENTRES. CAN THEY COPE? By Nicholas Cole, Data Centre Solution Manager, EXFO. MASTER AI BEFORE AI MASTERS YOUR BUSINESS By Michael Deheneffe, Director Marketing & Innovation at Orange Business Services, Digital & Data. THE EMPOWERING ROLE OF AI IN MARKETING By Jess Petrella, Director of Product Marketing at Unbounce. COULD EDGE COMPUTING UNLOCK AI’S VAST POTENTIAL? By Wayne Carter, VP Engineering, Couchbase. ABOUT US Datacentre Solutions is, quite simply, the most comprehensive, leading information resource covering the key technologies that underpin the digital revolution. Call Us: +44 (0) 2476 718 970 Email Us: hello@datacentre.solutions QUICK LINKS * About Us * Privacy Policy * Terms & Conditions * The Publishers SOCIAL * Twitter * Linkedin OUR OTHER PUBLICATIONS AND EVENTS © 2024 - Angel Business Communications Limited Made with by Angels