Better, faster, smarter: The Case for Data Warehouse Automation
Douglas Barrett, WhereScape
Learn how software can be used to solve one of the most pervasive problems in BI today – that is data warehouses take too long to deliver value to the business, and then become too hard to change. The need to store, integrate and prepare data for analysis is not going away – the data warehouse has a bright future, but according to TDWI, building a data warehouse is among the most labor-intensive and time-consuming activities of BI development. There are so many moving parts—requirements, source data analysis, data quality, source-target mapping, data acquisition, data transformation logic, ETL design, scheduling, error handling—and getting it right the first time isn’t easy. And when you finally do get it right, something changes.
The two areas of data warehouse automation include:
- Data warehouse design automation – a design tool that discovers and uses source system structures, rules and standards to accelerate data warehouse design.
- Data warehouse development automation – an IDE that uses metadata to generate and synchronize related development tasks – such as table management, index management, processing (ETL, ELT), documentation, deployment and scheduling. Metadata allows related development tasks to be combined to drastically reduce the time to delivery – and is used to enable agile / iterative development.
Join data warehouse automation pioneer WhereScape for this presentation to learn how companies like VW, Nike, Costco, Expedia, Blue Cross, F5 accelerate warehouse development and change cycles while simultaneously assuring quality and consistency. One of the most important aspects of doing automation right is that it should not get in the way of your developers – it should leverage existing skills, add best practices and generate documentation.
About the Speaker
Douglas is an experienced data solution architect that has worked in the field of data warehousing for close to 20 years. He has worked for Microsoft and WhereScape in Europe, New Zealand, Australia and for the last 5 years in the US. Douglas has led projects around the world at airlines, banks, retailers, healthcare providers and universities and given talks at SQL Saturdays, TDWI events and Tech Eds. Modeling and design is of course important, but over and over the need to adapt the project and model as a better understanding of data and requirements develops has proven to be the make or break of a project. The ability to remain agile in this regard is critical – the communications, tools, team and culture all need to be aligned.
WhereScape is the leading provider of automation software for planning, building and extending data vaults, data marts, data warehouses and analytic systems. Hundreds of customers use WhereScape to accelerate and automate development, leveraging their existing skills, team and platforms, without sacrificing flexibility or control.