www.databricks.com Open in urlscan Pro
2606:4700::6812:3b3  Public Scan

Form analysis
0 forms found in the DOM

Text Content

/* SAVE ON TRAINING */ Register today and get 50% off training with code
TRAIN50FOTY

Register now

June 10–13, 2024
San Francisco
 * / Agenda
 * / WHY ATTEND
 * / Pricing
 * / Speakers
 * + More
   * / FAQ
   * / Sponsors
   * / Event Archive

Log InRegister Now

SESSION


WHAT’S NEXT FOR THE UPCOMING APACHE SPARK 4.0?


OVERVIEW

EXPERIENCEIn PersonTYPEBreakoutTRACKData Engineering and
StreamingINDUSTRYEnterprise TechnologyTECHNOLOGIESApache SparkSKILL
LEVELIntermediateDURATION40

The upcoming release of Apache Spark 4.0 delivers substantial enhancements that
refine the functionality and augment the developer experience with the unified
analytics engine. This presentation will highlight:

 * Spark Connect’s GA for enhanced usability and debuggability.
 * Structured Logging for better error analysis and streamlined debugging.
 * Significant PySpark updates, including python data source APIs,
   arrow-optimized UDFs, polymorphic Python UDTFs, and improved UDF profiling,
   aligning with pandas 2.x for complex data workflows.
 * Expanded SQL capabilities through ANSI SQL compliance, and new SQL Cache V2,
   UDF, and Collation support.
 * Enhanced connectivity with new native XML and Databricks connectors.
 * Improvements in real-time data processing with the Arbitrary State API v2 and
   State Data source reader for Structured Streaming.

 

Attendees will learn how to use Apache Spark 4.0's advancements for optimized
data processing and analytics.


SESSION SPEAKERS


XIAO LI

/Engineering Director
Databricks

IMAGE COMING SOON


WENCHEN FAN

/Staff Software Engineer
Databricks

Organized by
*LIGHT / °DARK
Follow

Event Info
 * Agenda
 * WHY ATTEND
 * Pricing
 * Speakers

More
 * FAQ
 * Sponsors

Archive
 * Event Archive


 * Event Terms
 * Code of Conduct
 * Privacy Notice
 * Your Privacy Choices
 * Your California Privacy Rights
 * 

Apache, Apache Spark, Spark, and the Spark logo are trademarks of the Apache
Software Foundation. The Apache Software Foundation has no affiliation with and
does not endorse the materials provided at this event.






WE CARE ABOUT YOUR PRIVACY

By clicking “Accept All Cookies”, you agree to the storing of cookies on your
device to enhance site navigation, analyze site usage, and assist in our
marketing efforts.
Reject all cookies Accept all cookies
Manage Preferences



PRIVACY PREFERENCE CENTER




 * YOUR PRIVACY


 * STRICTLY NECESSARY COOKIES


 * PERFORMANCE COOKIES


 * FUNCTIONAL COOKIES


 * TARGETING COOKIES

YOUR PRIVACY

When you visit any website, it may store or retrieve information on your
browser, mostly in the form of cookies. This information might be about you,
your preferences or your device and is mostly used to make the site work as you
expect it to. The information does not usually directly identify you, but it can
give you a more personalized web experience. Because we respect your right to
privacy, you can choose not to allow some types of cookies. Click on the
different category headings to find out more and change our default settings.
However, blocking some types of cookies may impact your experience of the site
and the services we are able to offer.
More information

STRICTLY NECESSARY COOKIES

Always Active

These cookies are necessary for the website to function and cannot be switched
off in our systems. They are usually only set in response to actions made by you
which amount to a request for services, such as setting your privacy
preferences, logging in or filling in forms. You can set your browser to block
or alert you about these cookies, but some parts of the site will not then work.

PERFORMANCE COOKIES

Performance Cookies


These cookies allow us to count visits and traffic sources so we can measure and
improve the performance of our site. They help us to know which pages are the
most and least popular and see how visitors move around the site.

FUNCTIONAL COOKIES

Functional Cookies


These cookies enable the website to provide enhanced functionality and
personalization. They may be set by us or by third party providers whose
services we have added to our pages. If you do not allow these cookies then some
or all of these services may not function properly.

TARGETING COOKIES

Targeting Cookies


These cookies may be set through our site by our advertising partners. They may
be used by those companies to build a profile of your interests and show you
relevant advertisements on other sites. If you do not allow these cookies, you
will experience less targeted advertising.

Back Button


COOKIE LIST

Filter Button
Consent Leg.Interest
checkbox label label
checkbox label label
checkbox label label

Clear
checkbox label label
Apply Cancel
Confirm My Choices
Reject All Allow All