Enterprise Data Modeling in the World of Big Data

Enterprise Data Modeling in the World of Big Data

Ivan Schotsmans, BI-Community

We are all familiar with the software development cycle. The six steps Planning, Defining, Designing, Building, Testing and Deployment are etched into our brains. We design before we start implementing. When we design a data model like this, it gives us an understanding of the main business areas. But in the world of Big Data, data scientists dive right in with discovery and analysis. A “schema on read” is created that loads the data more or less as-is, and the eventual schema evolves, gets designed when the data are pulled from the big data environment. For most data scientists a “schema on read” satisfies their needs, but where is the single version of the truth?

It has been shown that Big Data can benefit from several aspects that an Enterprise Data Model can offer. The data governance set-up, defined business areas, and exposing business rules are an extremely valuable foundation for your Big Data environment.

How do we combine these two different views, and foster collaboration?

About the Speaker

Ivan Schotsmans is principal and founder of BI-Community.org. He has more than twenty-five years of information management experience in various industries. Throughout his career Ivan has focused on providing straightforward solutions to business and technical problems for International companies with a focus on data warehousing, business intelligence and information quality. He is recognized as subject matter expert in data modeling, information quality and agile business intelligence. Ivan is also (co-)founder and active member of several global organizations (TDWI Benelux Chapter, DAMA, IAIDQ, among others) and for two years he acted as Global Director for IAIDQ. Ivan frequently speaks at information management industry conferences and teaches on graphical facilitation, data warehousing, data modeling and new information management trends.