New research from Talend identifies cloud data warehouse trends and best practices. The Transforming Data with Intelligence (TDWI) survey highlights how to optimise the return of cloud data warehouse investments.
Cloud Data Warehouse Survey
A survey commissioned by Talend found that a new cloud data warehouse (CDW) offers broader data capabilities, stronger performance, and greater flexibility than traditional on-premise databases. The survey found that while CDWs are often an important first step in digital transformation. Enterprises need to follow some best practices to overcome implementation challenges and increase investment return.
“TDWI sees a wide range of data-driven IT systems moving to the cloud aggressively, and this includes the data warehouse,” said Philip Russom, Senior Research Director, Data Management at TDWI. “Cloud [architecture] gives the data warehouse the elastic scale, agnostic storage, multi-tenant access, and controlled cost it needs for modern requirements. However, cloud data warehouses should be complemented with substantial data integration infrastructure to unify the many pieces of the warehouse with all the data sources and targets available.”
Cloud Success Story
Decision Resources Group (DRG) is one example of this. DRG manages comprehensive data repositories covering 90 per cent of the U.S. healthcare system. DRG was struggling to combine and organise their data sources. Healthcare data is stored in a structured way, creating the need for DRG to clean and normalise millions of records and group data to assess patient needs and market conditions. DRG was successful in switching to a cloud-first strategy by implementing Talend and the Snowflake cloud data warehouse as the foundation of its new Real World Data Platform. Because of this, DRG became 150 per cent more productive without increasing costs, and have since onboarded 100 terabytes of data in just three months. The organisation can now supply more meaningful data enabling physicians to understand different patient populations and provider markets to interact with them more efficiently.
The full results of the survey with feedback from more than 200 data architects, and senior IT and analytics leaders can be downloaded here.