blog.min.io
Open in
urlscan Pro
2a04:4e42:600::775
Public Scan
Submitted URL: http://blog.min.io/
Effective URL: https://blog.min.io/
Submission: On January 03 via manual from US — Scanned from DE
Effective URL: https://blog.min.io/
Submission: On January 03 via manual from US — Scanned from DE
Form analysis 2 forms found in the DOM
POST https://forms.hsforms.com/submissions/v3/public/submit/formsnext/multipart/5728672/41b28d00-698a-4a6a-b68c-b2f85190a5cd
<form id="hsForm_41b28d00-698a-4a6a-b68c-b2f85190a5cd" method="POST" accept-charset="UTF-8" enctype="multipart/form-data" novalidate=""
action="https://forms.hsforms.com/submissions/v3/public/submit/formsnext/multipart/5728672/41b28d00-698a-4a6a-b68c-b2f85190a5cd"
class="hs-form-private hsForm_41b28d00-698a-4a6a-b68c-b2f85190a5cd hs-form-41b28d00-698a-4a6a-b68c-b2f85190a5cd hs-form-41b28d00-698a-4a6a-b68c-b2f85190a5cd_30e9c077-648d-48ea-bc32-f3194608a522 email-subscription__form hs-form hs-custom-style"
target="target_iframe_41b28d00-698a-4a6a-b68c-b2f85190a5cd" data-instance-id="30e9c077-648d-48ea-bc32-f3194608a522" data-form-id="41b28d00-698a-4a6a-b68c-b2f85190a5cd" data-portal-id="5728672">
<div class="hs_email hs-email hs-fieldtype-text field hs-form-field"><label id="label-email-41b28d00-698a-4a6a-b68c-b2f85190a5cd" class="" placeholder="Enter your Email" for="email-41b28d00-698a-4a6a-b68c-b2f85190a5cd"><span>Email</span><span
class="hs-form-required">*</span></label>
<legend class="hs-field-desc" style="display: none;"></legend>
<div class="input"><input id="email-41b28d00-698a-4a6a-b68c-b2f85190a5cd" name="email" required="" placeholder="Email address" type="email" class="hs-input" inputmode="email" autocomplete="email" value=""></div>
</div>
<div class="hs_lead_source hs-lead_source hs-fieldtype-select field hs-form-field" style="display: none;"><label id="label-lead_source-41b28d00-698a-4a6a-b68c-b2f85190a5cd" class="" placeholder="Enter your Lead Source"
for="lead_source-41b28d00-698a-4a6a-b68c-b2f85190a5cd"><span>Lead Source</span></label>
<legend class="hs-field-desc" style="display: none;"></legend>
<div class="input"><input name="lead_source" class="hs-input" type="hidden" value="Website - Subscription"></div>
</div>
<div class="hs_submit hs-submit">
<div class="hs-field-desc" style="display: none;"></div>
<div class="actions"><input type="submit" class="hs-button primary large" value="Submit"></div>
</div><input name="hs_context" type="hidden"
value="{"embedAtTimestamp":"1704298585397","formDefinitionUpdatedAt":"1680659694698","lang":"en","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.129 Safari/537.36","pageTitle":"MinIO Blog","pageUrl":"https://blog.min.io/","isHubSpotCmsGeneratedPage":false,"formTarget":"#hbspt-form-30e9c077-648d-48ea-bc32-f3194608a522","rumScriptExecuteTime":217.59999990463257,"rumTotalRequestTime":477.3999996185303,"rumTotalRenderTime":514.5,"rumServiceResponseTime":259.7999997138977,"rumFormRenderTime":37.10000038146973,"locale":"en","timestamp":1704298585523,"originalEmbedContext":{"portalId":"5728672","formId":"41b28d00-698a-4a6a-b68c-b2f85190a5cd","region":"na1","target":"#hbspt-form-30e9c077-648d-48ea-bc32-f3194608a522","isBuilder":false,"isTestPage":false,"isPreview":false,"css":"","cssClass":"email-subscription__form","isMobileResponsive":true},"correlationId":"30e9c077-648d-48ea-bc32-f3194608a522","renderedFieldsIds":["email","lead_source"],"captchaStatus":"NOT_APPLICABLE","emailResubscribeStatus":"NOT_APPLICABLE","isInsideCrossOriginFrame":false,"source":"forms-embed-1.4371","sourceName":"forms-embed","sourceVersion":"1.4371","sourceVersionMajor":"1","sourceVersionMinor":"4371","allPageIds":{},"_debug_embedLogLines":[{"clientTimestamp":1704298585483,"level":"INFO","message":"Retrieved customer callbacks used on embed context: [\"onFormSubmit\",\"onFormSubmitted\"]"},{"clientTimestamp":1704298585483,"level":"INFO","message":"Retrieved pageContext values which may be overriden by the embed context: {\"pageTitle\":\"MinIO Blog\",\"pageUrl\":\"https://blog.min.io/\",\"userAgent\":\"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.129 Safari/537.36\",\"isHubSpotCmsGeneratedPage\":false}"},{"clientTimestamp":1704298585484,"level":"INFO","message":"Retrieved countryCode property from normalized embed definition response: \"DE\""}]}"><iframe
name="target_iframe_41b28d00-698a-4a6a-b68c-b2f85190a5cd" data-lf-form-tracking-inspected-dzlr5a5kkja7boq2="true" data-lf-yt-playback-inspected-dzlr5a5kkja7boq2="true" data-lf-vimeo-playback-inspected-dzlr5a5kkja7boq2="true"
style="display: none;"></iframe>
</form><form id="quote-form" class="form" novalidate="novalidate">
<div class="quote__step">
<i>1</i>
<div class="quote__step__content">
<h3>Select Plan</h3>
<div class="quote__plan">
<input type="radio" name="plan" id="quote-plan-standard" value="Standard" checked="">
<label for="quote-plan-standard">Standard</label>
<input type="radio" name="plan" id="quote-plan-enterprise" value="Enterprise">
<label for="quote-plan-enterprise">Enterprise</label>
</div>
</div>
</div>
<div class="quote__step">
<i>2</i>
<div class="quote__step__content">
<h3>Choose Capacity</h3>
<div class="quote__capacity">
<div class="slider noUi-target noUi-ltr noUi-horizontal noUi-txt-dir-ltr" id="slider-quote">
<div class="noUi-base">
<div class="noUi-connects">
<div class="noUi-connect" style="transform: translate(0%, 0px) scale(0, 1);"></div>
</div>
<div class="noUi-origin" style="transform: translate(-1000%, 0px); z-index: 4;">
<div class="noUi-handle noUi-handle-lower" data-handle="0" tabindex="0" role="slider" aria-orientation="horizontal" aria-valuemin="100.0" aria-valuemax="20000.0" aria-valuenow="100.0" aria-valuetext="100.00">
<div class="noUi-touch-area"></div>
</div>
</div>
</div>
</div>
<div class="quote__capacity__input">
<input type="text" name="capacity" id="slider-quote-input" value="100" maxlength="5" pattern="[0-9]*">
<span class="quote__unit" id="quote-unit">TB</span>
</div>
</div>
</div>
</div>
<div class="quote__step">
<i>3</i>
<div class="quote__step__content">
<div class="quote__details">
<div class="form__group">
<label class="form__label" for="quote-name"><span>*</span> Name</label>
<input id="quote-name" type="text" name="name" class="form__control">
</div>
<div class="form__group">
<label class="form__label" for="quote-email"><span>*</span> Business Email</label>
<input id="quote-email" type="email" name="business-email" class="form__control">
</div>
</div>
</div>
</div>
<footer class="quote__footer">
<div class="form__message"></div>
<button type="submit" class="btn btn--theme-blue">Submit</button>
</footer>
</form>Text Content
Customer Login
Product
Multi-Cloud
MinIO for Kubernetes MinIO for VMware Tanzu MinIO for OpenShift MinIO for SUSE
Rancher MinIO for Amazon Elastic Kubernetes Service MinIO for Azure Kubernetes
Service MinIO for Google Kubernetes Engine
Features
Multi-Site Replication Global Identity and Access Management Encryption Bucket &
Object Immutability Bucket & Object Versioning Data Life Cycle Management &
Tiering Automated Data Management Interfaces Monitoring Scalability AWS S3
Compatibility
Hybrid Cloud Object Storage
Overview Architecture
Baremetal
Overview Architecture
Erasure Code Calculator Reference Hardware
Solutions
Modern Datalakes Modern, multi-engine datalakes depend on object stores that
deliver performance at scale. Learn more about this core MinIO use case. AI&ML
Object storage is powering the AI revolution. Learn how MinIO is leading that
effort with performance at scale. Integrations Browse our vast portfolio of
integrations SQL Server Discover how to pair SQL Server 2022 with MinIO to run
queries on your data on any cloud - without having to move it. Commvault Learn
how Commvault and MinIO are partnered to deliver performance at scale for
mission critical backup and restore workloads. Snowflake Query and analyze
multiple data sources, including streaming data, residing on MinIO with the
Snowflake Data Cloud. No need to move the data, just query using SnowSQL. Splunk
Find out how MinIO is delivering performance at scale for Splunk SmartStores
Veeam Learn how MinIO and Veeam have partnered to drive performance and
scalability for a variety of backup use cases. HDFS Migration Modernize and
simplify your big data storage infrastructure with high-performance,
Kubernetes-native object storage from MinIO. VMware Discover how MinIO
integrates with VMware across the portfolio from the Persistent Data platform to
TKGI and how we support their Kubernetes ambitions.
Docs Blog Resources Training Partner Pricing Download
Search Ctrl K
Topics
All Architect's Guide Operator's Guide Best Practices AI/ML Modern Data Lakes
Performance Kubernetes Integrations Benchmarks Security Multicloud
LANCEDB: YOUR TRUSTED STEED IN THE JOUST AGAINST DATA COMPLEXITY
Brenna Buuck Brenna Buuck on Vector Database 29 December 2023
Joust against data complexity with LanceDB, a lightning-fast vector database
optimized for AI/ML on the open-source Lance format. Teaming up with MinIO, it
scales seamlessly, offering high-performance, cloud-native storage. Dive into
the tutorial for a swift deployment.
Read more...
THE BLOG YEAR IN REVIEW: TOP 10 FOR 2023
Sasha Wodtke Sasha Wodtke on 29 December 2023
With only a few days left in 2023 (who else can’t believe it?), we have been
taking some time to look back on what an amazing year it’s been. There have been
so many highlights. Whether it’s been the many awards, conferences, or meeting
so many of you, we are eternally grateful! The biggest part of MinIO
Read more...
DISTRIBUTED TRAINING AND EXPERIMENT TRACKING WITH RAY TRAIN, MLFLOW, AND MINIO
Keith Pijanowski Keith Pijanowski on AI/ML 28 December 2023
Over the past few months, I have written about a number of different
technologies (Ray Data, Ray Train, and MLflow). I thought it would make sense to
pull them all together and deliver an easy-to-understand recipe for distributed
data preprocessing and distributed training using a production-ready MLOPs tool
for tracking and model serving. This post integrates the code I presented
Read more...
RECENT LAUNCH OF AMAZON S3 EXPRESS ONE ZONE VALIDATES THAT OBJECT STORAGE IS
PRIMARY STORAGE FOR AI
Matt Sarrel Matt Sarrel @msarrel on 21 December 2023
We have made the case for several years that in modern data stacks object
storage is primary storage.. This is even more true in the age of AI where
enterprises focus almost exclusively on object storage. The modern data stack
relies on disaggregated compute and storage alongside cloud-native microservices
running in containers on Kubernetes. As more enterprises shift to this
Read more...
DISTRIBUTED TRAINING WITH RAY TRAIN AND MINIO
Keith Pijanowski Keith Pijanowski on AI/ML 20 December 2023
Most machine learning projects start off as a single-threaded proof of concept
where each task is completed before the next task can begin. The single-threaded
ML pipeline depicted below is an example. However, at some point, you will
outgrow the pipeline shown above. This may be caused by datasets that no longer
fit into the memory of a single process.
Read more...
THE FOREST AMIDST THE TREES - THE TAKEAWAY FROM OUR AI YEAR
Jonathan Symonds Jonathan Symonds on AI/ML 20 December 2023
The calendar year 2023 will be a meaningful one, perhaps one of the most
meaningful ones, when the history of AI is written. It was, in essence, the big
bang. It started in late 2022 with OpenAI’s ChatGPT but it was the response
that was so breathtaking. Within months we had Meta’s LLaMA 2, Google’s Bard
chatbot
Read more...
LESSONS FROM THE HYPERSCALERS: HOW OBJECT STORAGE POWERS THE NEXT WAVE OF
MANAGED SERVICES SUCCESS
Brenna Buuck Brenna Buuck on AI/ML 19 December 2023
Rising interest in super-fast analytical databases like ClickHouse Cloud and
MotherDuck highlights the benefits of decoupling storage and compute. This
architecture, exemplified in AI applications, enhances scalability, speed, and
cost efficiency, and is driving a shift towards object storage.
Read more...
AIRGAPPED MINIO DEPLOYMENTS
AJ AJ on DevOps 18 December 2023
In this post we’ll talk about what is an Airgapped Network, what to consider
when deploying MinIO in such an environment and how to replicate and scale it
thereafter with other airgapped sites.
Read more...
DAY 2 WITH MINIO: SCALING, HARDWARE OPS, ADMINISTRATION
AJ AJ on DevOps 18 December 2023
In today’s post, we’ll go deeper into some of the considerations for long-term
MinIO management that you need to take into account, so that when Day 2 does
roll around 48 hours later you have all your ducks in a row.
Read more...
DATA SCIENCE AND AI WITH A SQL SERVER 2022 DATA LAKEHOUSE
Matt Sarrel Matt Sarrel @msarrel on SQL 18 December 2023
Microsoft SQL Server 2022 is one of the most commonly implemented enterprise
relational databases. Many of the world's most successful companies, regardless
of vertical, have significant SQL Server deployments. Thousands of companies
have relied on SQL Server for decades. Microsoft has made great strides over the
past decade in embracing open-source and standards-compliant technologies. The
result is that instead of
Read more...
SCALING UP MINIO INTERNAL CONNECTIVITY
Klaus Post Klaus Post on Webhook 15 December 2023
A MinIO cluster operates as a uniform cluster. This means that any request must
be seamlessly handled by any server. As a consequence, servers need to
coordinate between themselves. This has so far been handled with traditional
HTTP RPC requests - and this has served us well. Whenever server A would like
to call server B an HTTP request would
Read more...
THE FOUNDATION OF YOUR AI INFRASTRUCTURE: A MODERN DATALAKE
Keith Pijanowski Keith Pijanowski on AI/ML 12 December 2023
Amid the fervor to adopt AI is a critical and often overlooked truth - the
success of any AI initiative is intrinsically tied to the quality, reliability
and performance of the underlying data infrastructure. If you don't have the
proper foundation, you are limited in what you can build and therefore what you
can achieve. Your data infrastructure is the
Read more...
A GUIDE TO DECOUPLED STORAGE WITH STARROCKS AND MINIO
Brenna Buuck Brenna Buuck on Open Source 12 December 2023
The combination of StarRocks and MinIO offers a cloud-native, flexible, and
efficient data architecture for modern enterprises, enabling independent scaling
and optimized resource utilization. Read the full tutorial for insights into
cloud-native analytics with StarRocks and MinIO
Read more...
SMOOTH SAILING FROM DOCKER TO LOCALHOST
David Cannan David Cannan on Docker 8 December 2023
Explore the integration of Dockerized MinIO with localhost Flask apps. This
guide addresses Docker networking challenges, ensuring seamless MinIO and Flask
communication for a development environment that closely mirrors production.
Dive into practical solutions for robust workflows.
Read more...
TWO THINGS CAN BE TRUE AT THE SAME TIME
Moiz Kohari Moiz Kohari on Cloud Operating Model 6 December 2023
There is an interesting report out from McKinsey on the impending impact of AI
on an enterprise’s cloud investments. There was a quote early on in the piece
where McKinsey states:“While the possible impact varies by sector, adopting
cloud represents an opportunity for the average company to increase
profitability by 20 to 30 percent.” To many, this would
Read more...
DISTRIBUTED DATA PROCESSING WITH RAY DATA AND MINIO
Keith Pijanowski Keith Pijanowski on AI/ML 4 December 2023
Introduction Distributed data processing is a key component of an efficient
end-to-end distributed machine-learning training pipeline. This is true if you
are building a basic neural network for statistical predictions where
distributed training could mean each experiment runs in 10 minutes vs. an hour.
It is also true if you are training or fine-tuning a Large Language Model (LLM)
where
Read more...
WHAT THE INTEROPERABILITY TREND IN OPEN TABLE FORMATS MEANS FOR ENTERPRISE DATA
ARCHITECTURES
Brenna Buuck Brenna Buuck on Modern Data Lakes 30 November 2023
Discover how Databricks and Apache Iceberg's strides in open table formats
influence data portability in the modern data stack. Learn how the shift to a
private cloud operating model aligns with this evolution, fostering an
adaptable, interoperable data ecosystem.
Read more...
AI/ML REPRODUCIBILITY WITH LAKEFS AND MINIO
MinIO MinIO on AI/ML 27 November 2023
This post was written in collaboration with Amit Kesarwani from lakeFS. The
reality of running multiple machine learning experiments is that managing them
can become unpredictable and complicated - especially in a team environment.
What often happens is that during the research process, teams constantly change
configuration and data between experiments. For example, try several training
sets and several hyperparameter
Read more...
EVENT NOTIFICATIONS VS OBJECT LAMBDA
AJ AJ on Object Lambdas 23 November 2023
As we were writing the blogs on Event Notifications and Object Lambda we came to
a realization of why there are two different features doing almost the same
thing? Or are they? What is the difference between the Greek Lambda and
Lightning Bolt?
Read more...
DATA LAKE MYSTERIES UNVEILED: NESSIE, DREMIO, AND MINIO MAKE WAVES
Brenna Buuck Brenna Buuck on Dremio 21 November 2023
Unleash data collaboration and quality with Nessie! Learn to manage branches,
commits, and merges effortlessly. This guide walks you through deploying Dremio,
MinIO, and Nessie, transforming your data engineering with collaborative
precision. Dive in to revolutionize your workflows!
Read more...
123456
Older Posts
* © 2014-2023 MinIO, Inc.
Privacy Policy License Compliance
* COMPANY
About Partners Pricing Logo
* CONTACT
*
hello@min.io
*
275 Shoreline Dr, Ste 100,
Redwood City, CA 94065,
United States
* Sign up for MinIO Updates
Email*
Lead Source
Join us on Slack
GET A QUOTE
1
SELECT PLAN
Standard Enterprise
2
CHOOSE CAPACITY
TB
3
* Name
* Business Email
Submit