Dairy

Building a Data Platform for Better Decision-Making

SourceOne was being asked to serve far more queries than it was built for. We integrated the S3 data lakes and tuned the Redshift clusters, doubling daily query capacity past 100,000 without any change in service.

FrieslandCampina

2 min read
2×
the daily query capacity on SourceOne after we tuned it
100k+queries
now run against the platform every day
0service changes
needed from data consumers to get there

About the client

Royal FrieslandCompina (RFC) is the world's largest dairy cooperative, with over 11.5 billion USD in annual revenue. It produces dairy-based beverages, cheeses, desserts, and infant and sports nutrition products. These products are sold in more than 100 countries.

Since 2015, FrieslandCampina has started moving its applications to AWS to support its data-driven decision-making.

Why were we there?

For better decision-making, RFC built a data platform called SourceOne on the AWS Cloud. The platform stores and processes internal data from sources such as SAP and external data from sources including social media websites and point-of-sale systems.

DataChef joined RFC in achieving this goal by helping them set in place measures for a successful data lake formation.

How we helped

  • Integrating S3 DataLakes with SourceOne (RFC's data platform)

  • Optimizing Redshift Clusters to allow data consumers to run their queries more efficiently

  • Implementing scalable measures to ensure availability of data warehouses

The impact we made

  • Doubling the data-querying capabilities (100k+ per day) without service changes

  • Enabling RFC to move towards data-driven business operations

  • Saving on costs by optimization of the Redshift Cluster

Technologies we used

AWSAmazon RedshiftAmazon S3PythonDatabricks