www.confluent.io Open in urlscan Pro
2a05:d014:275:cb01:fc7b:9889:f71b:f9fa  Public Scan

Submitted URL: https://confluent.io/blog
Effective URL: https://www.confluent.io/blog/
Submission: On April 24 via api from US — Scanned from NL

Form analysis 3 forms found in the DOM

<form role="search"><svg class="cfHeaderNav-style-module--searchBarIcon--ZSA0y" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="search" role="img" viewBox="0 0 512 512">
    <path fill="currentColor"
      d="M505 442.7L405.3 343c-4.5-4.5-10.6-7-17-7H372c27.6-35.3 44-79.7 44-128C416 93.1 322.9 0 208 0S0 93.1 0 208s93.1 208 208 208c48.3 0 92.7-16.4 128-44v16.3c0 6.4 2.5 12.5 7 17l99.7 99.7c9.4 9.4 24.6 9.4 33.9 0l28.3-28.3c9.4-9.4 9.4-24.6.1-34zM208 336c-70.7 0-128-57.2-128-128 0-70.7 57.2-128 128-128 70.7 0 128 57.2 128 128 0 70.7-57.2 128-128 128z">
    </path>
  </svg><input type="search" placeholder="Search" autocomplete="off" autocorrect="off" autocapitalize="off" name="s" value="" class="style-module--input--fZLFL st-default-search-input" id="nav-search-input"><svg
    class="cfHeaderNav-style-module--inputBarResetIcon--JFpIe" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="times" role="img" viewBox="0 0 352 512">
    <path fill="currentColor"
      d="M242.72 256l100.07-100.07c12.28-12.28 12.28-32.19 0-44.48l-22.24-22.24c-12.28-12.28-32.19-12.28-44.48 0L176 189.28 75.93 89.21c-12.28-12.28-32.19-12.28-44.48 0L9.21 111.45c-12.28 12.28-12.28 32.19 0 44.48L109.28 256 9.21 356.07c-12.28 12.28-12.28 32.19 0 44.48l22.24 22.24c12.28 12.28 32.2 12.28 44.48 0L176 322.72l100.07 100.07c12.28 12.28 32.2 12.28 44.48 0l22.24-22.24c12.28-12.28 12.28-32.19 0-44.48L242.72 256z">
    </path>
  </svg></form>

<form><input type="text" placeholder="Search Blog" name="keyword" value="" class="style-module--input--fZLFL" id="keyword"><svg class="Search-module--buttonIcon--NxE18" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas"
    data-icon="search" role="img" viewBox="0 0 512 512">
    <path fill="currentColor"
      d="M505 442.7L405.3 343c-4.5-4.5-10.6-7-17-7H372c27.6-35.3 44-79.7 44-128C416 93.1 322.9 0 208 0S0 93.1 0 208s93.1 208 208 208c48.3 0 92.7-16.4 128-44v16.3c0 6.4 2.5 12.5 7 17l99.7 99.7c9.4 9.4 24.6 9.4 33.9 0l28.3-28.3c9.4-9.4 9.4-24.6.1-34zM208 336c-70.7 0-128-57.2-128-128 0-70.7 57.2-128 128-128 70.7 0 128 57.2 128 128 0 70.7-57.2 128-128 128z">
    </path>
  </svg></form>

<form>
  <div class="style-module--container--4hS4J">
    <div class="style-module--inputContainer--lMHLm"><input type="checkbox" name="All" checked="" class="style-module--input--fZLFL style-module--input--G3y20" id="All" value=""><span
        class="style-module--checkbox--OOyVA FilterAccordion-module--categoryCheckbox--Yd82g FilterAccordion-module--unClickable--LdKRK"></span></div><label class="style-module--label--AHN9+" for="All"><span
        class="FilterAccordion-module--checkboxLabel--Gopmw">All</span></label>
  </div>
  <div class="style-module--container--4hS4J">
    <div class="style-module--inputContainer--lMHLm"><input type="checkbox" name="Apache Kafka" class="style-module--input--fZLFL style-module--input--G3y20" id="Apache Kafka" value=""><span
        class="style-module--checkbox--OOyVA FilterAccordion-module--categoryCheckbox--Yd82g"></span></div><label class="style-module--label--AHN9+" for="Apache Kafka"><span class="FilterAccordion-module--checkboxLabel--Gopmw">Apache
        Kafka</span></label>
  </div>
  <div class="style-module--container--4hS4J">
    <div class="style-module--inputContainer--lMHLm"><input type="checkbox" name="Big Ideas" class="style-module--input--fZLFL style-module--input--G3y20" id="Big Ideas" value=""><span
        class="style-module--checkbox--OOyVA FilterAccordion-module--categoryCheckbox--Yd82g"></span></div><label class="style-module--label--AHN9+" for="Big Ideas"><span class="FilterAccordion-module--checkboxLabel--Gopmw">Big Ideas</span></label>
  </div>
  <div class="style-module--container--4hS4J">
    <div class="style-module--inputContainer--lMHLm"><input type="checkbox" name="Confluent" class="style-module--input--fZLFL style-module--input--G3y20" id="Confluent" value=""><span
        class="style-module--checkbox--OOyVA FilterAccordion-module--categoryCheckbox--Yd82g"></span></div><label class="style-module--label--AHN9+" for="Confluent"><span class="FilterAccordion-module--checkboxLabel--Gopmw">Confluent</span></label>
  </div>
  <div class="style-module--container--4hS4J">
    <div class="style-module--inputContainer--lMHLm"><input type="checkbox" name="Confluent Cloud" class="style-module--input--fZLFL style-module--input--G3y20" id="Confluent Cloud" value=""><span
        class="style-module--checkbox--OOyVA FilterAccordion-module--categoryCheckbox--Yd82g"></span></div><label class="style-module--label--AHN9+" for="Confluent Cloud"><span class="FilterAccordion-module--checkboxLabel--Gopmw">Confluent
        Cloud</span></label>
  </div>
  <div class="style-module--container--4hS4J">
    <div class="style-module--inputContainer--lMHLm"><input type="checkbox" name="Stream Processing" class="style-module--input--fZLFL style-module--input--G3y20" id="Stream Processing" value=""><span
        class="style-module--checkbox--OOyVA FilterAccordion-module--categoryCheckbox--Yd82g"></span></div><label class="style-module--label--AHN9+" for="Stream Processing"><span class="FilterAccordion-module--checkboxLabel--Gopmw">Stream
        Processing</span></label>
  </div>
  <div class="style-module--container--4hS4J">
    <div class="style-module--inputContainer--lMHLm"><input type="checkbox" name="The OCTOlog" class="style-module--input--fZLFL style-module--input--G3y20" id="The OCTOlog" value=""><span
        class="style-module--checkbox--OOyVA FilterAccordion-module--categoryCheckbox--Yd82g"></span></div><label class="style-module--label--AHN9+" for="The OCTOlog"><span class="FilterAccordion-module--checkboxLabel--Gopmw">The
        OCTOlog</span></label>
  </div>
  <div class="style-module--container--4hS4J">
    <div class="style-module--inputContainer--lMHLm"><input type="checkbox" name="Use Cases" class="style-module--input--fZLFL style-module--input--G3y20" id="Use Cases" value=""><span
        class="style-module--checkbox--OOyVA FilterAccordion-module--categoryCheckbox--Yd82g"></span></div><label class="style-module--label--AHN9+" for="Use Cases"><span class="FilterAccordion-module--checkboxLabel--Gopmw">Use Cases</span></label>
  </div>
</form>

Text Content

Show Me How: Build Streaming Data Pipelines for Cloud Databases | Register Today

Login Contact Us

 * Why Confluent
   * 
     Confluent vs. OSS Kafka®
     
     Streaming Data Pipelines
     
     Our Customers
     
     Our Partners
 * Products
   
   * Choose Your deployment
     
     
     Confluent Cloud
      * Pricing
      * Login
     
     
     Software: Confluent Platform
      * Subscription
   
   * 
     Stream Designer
     
     Connectors
     
     ksqlDB
     
     Stream Governance
     Confluent vs. Kafka: Why you need Confluent
     Confluent is 10x Kafka
     Streaming Data Pipelines
 * Solutions
   * 
     By Customer
     
     By Industry
     
     By Use Case
     
     By Architecture
     
     All Solutions
   * 
     Hybrid and Multicloud Modernization
     
     Event-driven Microservices
     
     Use Case Showcase
     Read the Streaming Data Pipelines eBook
 * Learn
   * 
     Blog
     
     Resources
     
     Training
     
     Professional Services
     
     Data Glossary
   * 
     Careers
     
     Events
      * Meetups
      * Kafka Summit
      * Current: Data Streaming Event
      * Webinars
     
     Streaming data pipelines demo
     Mastering Kafka Streams and ksqlDB
     Microservices with Confluent
 * Developers
   * 
     Confluent Developer
     
     Docs
   * Apache Kafka Quick Start
     Streaming Audio Podcast
     Ask the Community
 * Watch DemoGet Started Free
 * 
 * US English

Watch DemoGet Started Free

 * Watch DemoGet Started Free
 * 
 * Why Confluent
    * 
      Confluent vs. OSS Kafka®
      
      Streaming Data Pipelines
      
      Our Customers
      
      Our Partners

 * Products
   
    * Choose Your deployment
      
      
      Confluent Cloud
       * Pricing
       * Login
      
      
      Software: Confluent Platform
       * Subscription
   
    * 
      Stream Designer
      
      Connectors
      
      ksqlDB
      
      Stream Governance
      Confluent vs. Kafka: Why you need Confluent
      Confluent is 10x Kafka
      Streaming Data Pipelines

 * Solutions
    * 
      By Customer
      
      By Industry
      
      By Use Case
      
      By Architecture
      
      All Solutions
    * 
      Hybrid and Multicloud Modernization
      
      Event-driven Microservices
      
      Use Case Showcase
      Read the Streaming Data Pipelines eBook

 * Learn
    * 
      Blog
      
      Resources
      
      Training
      
      Professional Services
      
      Data Glossary
    * 
      Careers
      
      Events
       * Meetups
       * Kafka Summit
       * Current: Data Streaming Event
       * Webinars
      
      Streaming data pipelines demo
      Mastering Kafka Streams and ksqlDB
      Microservices with Confluent

 * Developers
    * 
      Confluent Developer
      
      Docs
    * Apache Kafka Quick Start
      Streaming Audio Podcast
      Ask the Community

 * 


TECHNOLOGY BLOG

 * Technology
 * Customers & Business
 * Company

SubscribeRSS


CONFLUENT + IMMEROK: CLOUD NATIVE KAFKA MEETS CLOUD NATIVE FLINK

I'm excited to share our intent to acquire Immerok! Together, we’ll build a
cloud-native service for Apache Flink that delivers the same simplicity,
security, and scalability that you expect from Confluent for Kafka.

--------------------------------------------------------------------------------

 * Jay Kreps


STREAMING DATA PIPELINES: REINVENTING DATA FLOWS

The worlds of data integration and data pipelines are changing in ways that are
highly reminiscent of the profound changes I witnessed in application and
service development over the last twenty years.

--------------------------------------------------------------------------------

 * Ian Robinson


DIAGNOSE AND DEBUG APACHE KAFKA ISSUES: UNDERSTANDING REDUCED MESSAGE THROUGHPUT

When you encounter a problem with Apache Kafka®—for example, an exploding number
of connections to your brokers or perhaps some wonky record batching—it’s easy
to consider these issues as something to be solved in and of themselves...

--------------------------------------------------------------------------------

 * Danica Fine
 * Nikoleta Verbeck


CONFLUENT BLOG

categories


All

Apache Kafka

Big Ideas

Confluent

Confluent Cloud

Stream Processing

The OCTOlog

Use Cases
CLOUD-NATIVE SERVICE FOR APACHE KAFKA®

Harness the full power of data in motion while avoiding the headaches of
infrastructure management. Focus on what matters

Try Free



UNDERSTANDING AND OPTIMIZING YOUR KAFKA COSTS – PART 1: INFRASTRUCTURE

Apr 20, 2023

It's hard to properly calculate the cost of running Kafka. In part 1 of 4, learn
to calculate your Kafka costs based on your infrastructure, networking, and
cloud usage.

--------------------------------------------------------------------------------

 * Addison Huddy


UNKNOWN MAGIC BYTE! HOW TO ADDRESS MAGIC BYTE ERRORS IN APACHE KAFKA

Apr 11, 2023

If you’ve been working with Kafka Streams and have seen an “unknown magic byte”
error, you might be wondering what a magic byte is in the first place, and also,
how to resolve the error. This post explains the answers to both questions.

--------------------------------------------------------------------------------

 * Lucia Cerchie


UNITING THE MACHINE LEARNING AND DATA STREAMING ECOSYSTEMS - PART 2

Apr 4, 2023

The ML and data streaming markets have socio-technical blockers between them,
but they are finally coming together. Apache Kafka and stream processing
solutions are a perfect match for data-hungry models.

--------------------------------------------------------------------------------

 * Robbie Palmer


DATA CONTRACTS, MORE THAN JUST APIS?

Mar 30, 2023

Breaking encapsulation has led to a decade of problems for data teams. But is
the solution just to tell data teams to use APIs instead of extracting data from
databases? The answer is no. Breaking encapsulation was never the goal, only a
symptom of data and software teams not working together.

--------------------------------------------------------------------------------

 * Jack Vanlightly


UNITING THE MACHINE LEARNING AND DATA STREAMING ECOSYSTEMS - PART 1

Mar 28, 2023

Apache Kafka and stream processing solutions are a perfect match for data-hungry
models. Our community’s solutions can form a critical part of a machine learning
platform, enabling machine learning engineers to deliver real-time MLOps
strategies.

--------------------------------------------------------------------------------

 * Robbie Palmer


STREAM PROCESSING IN YOUR NATIVE TONGUE

Mar 23, 2023

Stream processing has long forced an uncomfortable trade-off: choose a framework
based on its power, or in your preferred programming language. GraalVM may offer
an alternative solution to avoid having to choose.

--------------------------------------------------------------------------------

 * Michael Drogalis


WHATEVER HAPPENED TO BIG DATA?

Mar 16, 2023

The big data revolution of the early 2000s saw rapid growth in data creation,
storage, and processing. A new set of architectures, tools, and technologies
emerged to meet the demand. But what of big data today? You seldom hear of it
anymore. Where has it gone?

--------------------------------------------------------------------------------

 * Adam Bellemare


CREATE STREAM DESIGNER PIPELINES WITH THE CONFLUENT CLI AND PIPELINES API

Mar 14, 2023

Use the Confluent CLI and API to create Stream Designer pipelines from SQL
source code.

--------------------------------------------------------------------------------

 * Jim Galasyn


REAL-TIME OR REAL VALUE? ASSESSING THE BENEFITS OF EVENT STREAMING

Mar 9, 2023

Experienced technology leaders know that adopting a new technology can be risky.
Often, we are unable to distinguish between those investments that will be
transformational and those that won’t be worthwhile. This post examines how one
can decide if event streaming makes sense for them.

--------------------------------------------------------------------------------

 * Andrew Sellers


STREAMING DATA PRODUCT LIFECYCLE MANAGEMENT

Mar 8, 2023

Learn how modern data management approaches like data mesh and event-driven
architecture (EDA) can be used to manage data platforms and how to take
advantage of them.

--------------------------------------------------------------------------------

 * Andrea Gioia
 * Pietro La Torre


WITH DATA, TRUST COMES FIRST

Mar 2, 2023

Perhaps the largest challenge for modern data teams is gaining and retaining
trust. The challenge of Big Data has come and gone, now we face the challenge of
Untrustworthy Data, which will be one of the core focal points of the data space
in 2023 and beyond.

--------------------------------------------------------------------------------

 * Jack Vanlightly


GETTING STARTED WITH PYTHON FOR APACHE KAFKA

Feb 28, 2023

Get an introduction to why Python is becoming a popular language for developing
Apache Kafka client applications. You will learn about several benefits that
Kafka developers gain by using the Python language.

--------------------------------------------------------------------------------

 * Dave Shook


MULTI-GEO REPLICATION 101 FOR APACHE KAFKA: THE WHAT, HOW, AND WHY

Feb 27, 2023

Discover tools, practices, and patterns for planning geo-replicated Apache Kafka
deployments to build reliable, scalable, secure, and globally distributed data
pipelines that meet your business needs.

--------------------------------------------------------------------------------

 * Sanjana Kaundinya


INTRODUCING THE OCTOLOG

Feb 24, 2023

The OCTOlog is a weekly publication of noteworthy concepts, trends, and
technologies relevant to the data streaming landscape—by Confluent’s Office of
the CTO (OCTO).

--------------------------------------------------------------------------------

 * Ben Stopford

See More

USE CL60BLOG TO GET AN ADDITIONAL $60 OF FREE CONFLUENT CLOUD

Get started
 * Product
 * Confluent Platform
 * Connectors
 * ksqlDB
 * Stream Governance
 * Confluent Hub
 * Subscription
 * Professional Services
 * Training
 * Customers

 * Cloud
 * Confluent Cloud
 * Support
 * Sign Up
 * Log In
 * Cloud FAQ

 * Solutions
 * Financial Services
 * Insurance
 * Retail and eCommerce
 * Automotive
 * Government
 * Gaming
 * Communication Service Providers
 * Technology
 * Manufacturing
 * Fraud Detection
 * Customer 360
 * Messaging Modernization
 * Streaming Data Pipelines
 * Event-driven Microservices
 * Mainframe Integration
 * SIEM Optimization
 * Hybrid and Multicloud
 * Internet of Things
 * Data Warehouse
 * Database

 * Developers
 * Confluent Developer
 * What is Kafka?
 * Resources
 * Events
 * Online Talks
 * Meetups
 * Current: Data Streaming Event
 * Tutorials
 * Docs
 * Blog

 * About
 * Investor Relations
 * Startups
 * Company
 * Careers
 * Partners
 * News
 * Contact
 * Shop Merchandise
 * Trust and Security

 * 
 * 
 * 
 * 
 * 
 * 
 * 

 * Also of Interest
 * * Monitoring-Articles, Tips, and Tutorials
   * Developer - Articles, Tips, and Tutorials
   * Harness Trusted, Quality Data...

 * 
 * 
 * 
 * 
 * 
 * 
 * 

Terms & Conditions | Privacy Policy | Do Not Sell My Information | Modern
Slavery Policy | Cookie Settings

Copyright © Confluent, Inc. 2014-2023. Apache, Apache Kafka, Kafka, and
associated open source project names are trademarks of the Apache Software
Foundation



By clicking “Accept All Cookies”, you agree to the storing of cookies on your
device to enhance site navigation, analyze site usage, and assist in our
marketing efforts. Cookie Notice

Cookies Settings Reject All Accept All Cookies