www.singlestore.com Open in urlscan Pro
2600:9000:2156:5c00:1d:6ef1:2fc0:93a1  Public Scan

Form analysis
0 forms found in the DOM

Text Content

The new 7.5 release is available now.
See what's new.

Times Icon

 * Product
   
   Managed Service
   Cloud Database-as-a-service
   
   Database Software
   Deploy SingleStore anywhere
   Stream Icon
   Ingest Data
   Tools Icon
   Tools and Monitoring
   Lock Icon
   Security
   Sync Icon
   Replace MySQL
 * Solutions
   
   Use Cases
   How SingleStore is used
   
   Customers
   Learn who uses SingleStore
   Briefcase Icon
   Professional Services
   Industry Icon
   Industries
   Sitemap Icon
   Architectures
   Check Icon
   Comparisons
 * Docs
   
   Documentation
   Set up and use SingleStore's products and tools
   
   How SingleStore Works
   A concise overview of SingleStore
   Life Ring Icon
   Support
   Comments Icon
   Forums
   List Icon
   Release Notes
 * Learn
   
   Developer Hub
   Begin building faster data applications
   
   Resources
   Whitepapers, ebooks, videos and more
   Calendar Icon
   Events
   Rss Icon
   Blog
   Newspaper Icon
   News
   Presentation Icon
   Training
   Video Icon
   Product Demo
 * Pricing
   
 * Contact Us
   Open Search

 * User Circle IconSign In
   
   Laptop Icon
   Portal
   Access Managed Service & Licenses
   Comments Icon
   Forums
   Ask the Community
   Users Class Icon
   Training
   Self-Paced Learning
   Life Ring Icon
   Enterprise Support
   Submit a Ticket
 * Start Free Arrow Right Icon
   

Case Study


NOVUS PARTNERS CASE STUDY

Gary Orenstein
Share to FacebookShare to TwitterShare to LinkedInShare to RedditShare to Email


SERVING INVESTMENT MANAGERS

Novus is a portfolio intelligence platform that helps the world’s top investors
generate higher returns. The company works with 100+ of the world’s top
investment managers and institutional investors, managing approximately \$2
trillion. The platform helps the industry’s top investors collectively innovate
and gain valuable insights into their investments.


CHANGING HOW THE WORLD INVESTS

(An edited transcript of this blog post, with updates, can be found here. Ed.)
Novus aims to change how the world invests by allowing their users to explore
investments from publicly sourced data, and to understand their risks and
potential returns. Users can log in to the Novus platform to analyze individual
hedge fund portfolios, aggregate industry trends, or analyze their own private
data.
According to Noah Zucker, Vice President of Tactical Engineering at Novus, “Our
mission is to help investors discover their true investment acumen, identify
their skill-sets, and understand potential risks.”


INITIALLY FACING AN ETL BARRIER

As the Novus team began to scale their platform, they encountered a barrier with
ETL (Extract, Transform, Load) that was causing them to monitor a delicate
process requiring handholding nearly 24/7. If there was an issue, they had to
immediately spring into action. And the worst cases of having to load jobs
during the day led to an application slowdown for all of the users.
They had tried scaling up with larger servers but the prior database could not
keep up. The team began investigating options to scale out on the cloud. In
particular they wanted to find an option that would not require heavy rework of
their application model. Essentially if they had had to introduce a sharding
strategy on their own, it would have required a change to business logic.

BEFORE SINGLESTORE…

24/7 ETL Handholding
Overnight Failure = Business Hours Slowdown
Scala worker pool limited by the database
Non-trivial code changes needed to shard and scale


INVESTING IN NEW TECHNOLOGIES

The team came across SingleStore and began to rework their pipeline. Clients
provide data in all sorts of formats, and that data is loaded through a cleanup
process into a persistent store.
Then the Novus platform takes that data and sends it into a distributed compute
layer of Scala nodes which then places the data in SingleStore so clients have
all of that data available to them. Now high intensity computations are
available to clients immediately instead of minutes or hours.


THE BOTTOM LINE FOR THE ETL TEAM

Typical load went down from 90 minutes to 2 minutes

WITH SINGLESTORE

Client team focuses on service, not ETL
Predictable application performance
Scala workers: 12 → 126
Add servers to scale – No code changes needed


KEEPING DEVELOPERS HAPPY

Anytime there is a database change, there is a potential to create extra work
for developers, but SingleStore uses the MySQL protocol for access, making the
experience familiar and comfortable for developers. There is an entire tool
chain available, and the learning curve is simple.
In addition, SingleStore has first class JSON support and the Novus team was
able to map their JSON format from MongoDB to SingleStore. They also wrote a
blog post about using the SingleStore JSON Column Type:
https://singlestore.com/blog/json-column-type/


BOTTOM LINE

For Novus, the bottom line was that the client data team could focus on
delivering value to customers and helping them understand data and investments
instead of tending to the ETL process during the day. In the event of any kind
of ETL failure during the day, there is no impact to end users.
Further, the Novus architecture is not limited by the prior database and the
team was able to scale from 12 to 126 workers Scala workers, more than 10x
improvement. Now for further scale, they can just add more servers to the
database.
For Novus, SingleStore fits the operational model. As an application developer
there is no need to change the code to increase scale. By having a set of well
written SQL code, the ops team can scale by just adding more servers.
With SingleStore, Novus can manage the installation with just one DBA and
architect for few hours a week, and they do not have to devote a whole team for
care and feeding of the data platform.
“It pretty much takes care of itself once we have it set up” – Noah Zucker, VP,
Engineering – Novus
Hear directly from Novus at Strata + Hadoop World New York September 2015:
https://youtu.be/RvyB_ogIDSE
June 14th, 2016Last Modified - Invalid date
Tag Icon
Case Study

--------------------------------------------------------------------------------

Gary Orenstein
Former Chief Marketing Officer, SingleStore

RELATED POSTS

Case Study10 min Read
GOGUARDIAN’S EDUCATION TECHNOLOGY PLATFORM, POWERED BY SINGLESTORE DB, SCALES TO
SERVE OVER 1…

Over the past year, the pandemic has drastically altered the educational
landscape. 55 million K-12 students in the United States suddenly…
Read Post

Case Study10 min Read
IEX CLOUD PROCESSES OVER 2.5B API REQUESTS DAILY WITH AN 8MS AVERAGE RESPONSE
TIME USING SIN…

Existing financial data offerings are not built for modern technology. They
can’t keep up with the scale and speed needed to support…
Read Post

Case Study8 min Read
CASE STUDY: IMPROVING RISK MANAGEMENT PERFORMANCE WITH SINGLESTORE AND KAFKA

Risk management is a critical task throughout the world of finance (and
increasingly in other disciplines as well). It is a significant area…
Read Post
Introducing


SINGLESTORE MANAGED SERVICE

THE WORLD'S FASTEST CLOUD DATABASE

Learn More
 * Product
 * Managed Service
 * Database Software
 * Ingest Data
 * Tools and Monitoring
 * Security
 * Pricing

 * Solutions
 * Use Cases
 * Customers
 * Industries
 * Architectures
 * Comparisons

 * Learn
 * Developer Hub
 * Forums
 * Events
 * Resources
 * Blog
 * News

 * Support
 * Support Plans
 * Support FAQ
 * Professional Services
 * Documentation
 * Training

 * Company
 * About Us
 * Leadership
 * Careers We're hiring
 * Partners
 * SingleStore.org
 * Contact Us

Twitter IconFacebook IconLinkedin In IconYoutube IconDiscourse IconGithub Icon
© SingleStore, Inc. |
Privacy Policy | Terms of Service | Legal Terms and Conditions

By browsing this site, you accept the use of cookies as they help us optimize
your experience. Learn more
OK