Transforming an organization to become more data driven usually presents a set of technological challenges. In this session you will learn how to integrate existing applications data in real time to achieve a useful critical mass of explorable data.
Target Audience: CTOs, CIOs, CDOs, Data Engineers, Data Modelers, Data Analysts, Data Scientists
Prerequisites: General understanding of data in the context of the enterprise
'Data is the new oil' - these days many organizations are in the midst of a digital transformation. In order to enable data driven processes, it is imperative to leverage the treasure trove of data hidden away in already existing applications. Extracting data from those applications (the E in ETL) is commonly the biggest pain point of data engineering. Many systems were not built to be extracted, so therefore data engineering needs to carefully balance performance versus load. At the same time customers demand more: nightly batch processing is not good enough anymore, the need for real time information is growing. How to align all of this? Enter Change Data Capture (CDC). Based on a real live use case, you will learn how to integrate data from an existing mission critical SAP application into a modern cloud based analytics warehouse. We will tell the story of our journey from the initial use cases, constraints that we faced, discoveries along the way to the final design and our appetite for more.
Cloud-first digital transformation modernizing Logitech's analytics architecture entirely on the cloud by creating a governed and secure data layer in AWS cloud with Denodo, Snowflake and Tableau. Logitech was able to accomplish not only running analytics at scale with the help of a logical semantic data layer but also optimizing data availability to their business users without any interruption of service during the migration from on-premises to the cloud.
Target Audience: Business Analysts, BI Analysts, Data Analysts, Data Scientists, Enterprise Architects, Cloud Architects, Solution Architects
Prerequisites: People with BI background