TDWI Konferenz mit BARC@TDWI Track 2019

München, 24. - 26. Juni 2019

Partner

Sessionsdetails

Vortrag: Mo 7.1
Datum: Mo, 24.06.2019
Uhrzeit: 10:45 - 12:15
cart

Continuous Intelligence – Shifting Data Applications From Proof of Concept To Production

Uhrzeit: 10:45 - 12:15
Vortrag: Mo 7.1

 

Moving the work of data scientists from their analytics notebooks to production is often a slow, manual and error prone process.
In our talk we present how the principles of Continuous Integration and Continuous Delivery can be applied to data and machine learning applications. We will describe how to manage a development environment consisting of automatic pipelines for code and data to continuously move the work of your rare and expensive data scientists into your production environment at any time reliable and scalable - what we call Continuous Intelligence. In our talk we will illustrate this with our experience in several customer projects and some live demonstrations.

Target Audience: Architects, Developers, BI Engineers, Data Scientists, Machine Learning Engineers
Prerequisites: Basic understanding of software development processes. Basic understanding of how data scientists work
Level: Advanced

Extended Abstract
'Data Scientists working on the company's big data usually work in their own environment consisting of data sources, statistical modeling languages, machine learning frameworks and personal analytics notebooks. Moving their hand-crafted and optimized data models and algorithms into production usually isn't their business. Data engineers, developers and operations engineers take over to deploy the work of the data scientists, sometimes reimplementing everything. And when data scientists update their models with new data, the whole process starts from the beginning. This takes a long time, is cumbersome and error prone.

At ThoughtWorks, we're pioneers in Continuous Delivery, where tools and processes ensure that software under development can be reliably released at any time and with high frequency. In our talk we present how the principles of Continuous Integration (CI) and Continuous Delivery (CD) can be applied to data and machine learning applications. We will describe how CI/CD tools like GoCD and data science versioning control (DVC) tools can work together to manage a development environment consisting of automatic pipelines for code and data. With this technique, the valuable work of your rare and expensive data scientists can be continuously moved into your production environment to be deployed at any time reliable and scalable - what we call Continuous Intelligence.

In this talk, we will introduce you to the principles of Continuous Intelligence. We will demonstrate how the principles work in practice with some live demonstrations and illustrate the talk with our experience in real customer projects.

 

Sponsoren TDWI München 2019

  • Ab Initio Software Germany GmbH Platinsponsor
  • Adastra GmbH Platinsponsor
  • Databricks Platinsponsor
  • Denodo Technologies Platinsponsor
  • Exasol Platinsponsor
  • Fujitsu Platinsponsor
  • INFOMOTION GmbH Platinsponsor
  • itelligence Platinsponsor
  • ITGAIN Consulting Gesellschaft für IT-Beratung mbH Platinsponsor
  • Microsoft Platinsponsor
  • MicroStrategy Platinsponsor
  • NTT DATA Deutschland Platinsponsor
  • SAP Deutschland SE & Co. KG Platinsponsor
  • Sopra Steria Consulting Platinsponsor
  • Talend Germany GmbH Platinsponsor
  • Tech Data GmbH & Co. OHG Platinsponsor
  • Trivadis GmbH Platinsponsor
  • WhereScape Europe Platinsponsor
  • 2150 GmbH | Distilling business insight. Goldsponsor
  • Actian Goldsponsor
  • adesso AG Goldsponsor
  • Alation Goldsponsor
  • ASG Technologies Goldsponsor
  • b.telligent GmbH & Co. KG Goldsponsor
  • blueforte GmbH Goldsponsor
  • CIMACON GmbH Goldsponsor
  • Collibra UK Limited Goldsponsor
  • Cubeware GmbH Goldsponsor
  • Data Virtuality GmbH Goldsponsor
  • Dataiku Goldsponsor
  • Dell Boomi Goldsponsor
  • Deloitte Goldsponsor
  • erwin, Inc. Goldsponsor
  • EVACO GmbH Goldsponsor
  • Genesee Academy Goldsponsor
  • heureka e-Business GmbH Goldsponsor
  • IBM Goldsponsor
  • Informatica GmbH Goldsponsor
  • INFORMATION WORKS GmbH Goldsponsor
  • integration-factory GmbH & Co. KG Goldsponsor
  • Marmeladenbaum GmbH Goldsponsor
  • mayato GmbH Goldsponsor
  • MID GmbH Goldsponsor
  • Neo4j Goldsponsor
  • OPITZ CONSULTING Goldsponsor
  • pmOne Group Goldsponsor
  • Poslovna inteligencija d.o.o. Goldsponsor
  • PPI AG Goldsponsor
  • PROCON IT AG Goldsponsor
  • SEVEN PRINCIPLES AG Goldsponsor
  • SISENSE Goldsponsor
  • Snowflake Goldsponsor
  • Syncwork AG Goldsponsor
  • T-Systems Multimedia Solutions Goldsponsor
  • TIBCO Goldsponsor
  • TIMETOACT Software & Consulting GmbH Goldsponsor
  • Vertica Goldsponsor
  • accantec consulting AG Silbersponsor
  • AnalyticsCreator Solutions GmbH Silbersponsor
  • areto consulting GmbH Silbersponsor
  • Attunity Ltd. Silbersponsor
  • Axians IT Solutions GmbH Silbersponsor
  • BARC GmbH Silbersponsor
  • BBF GmbH Silbersponsor
  • biGenius Silbersponsor
  • BIVAL GmbH Silbersponsor
  • brainLight Silbersponsor
  • cimt ag Silbersponsor
  • CINTELLIC Consulting Group Silbersponsor
  • Cognizant Digital Business Silbersponsor
  • Confexx Consulting GmbH Silbersponsor
  • Data Insights GmbH Silbersponsor
  • Data Reply Silbersponsor
  • data42morrow Silbersponsor
  • datasqill - The Post-ETL Silbersponsor
  • Digital Ratio GmbH Silbersponsor
  • Disy Informationssysteme GmbH Silbersponsor
  • Empalis Consulting GmbH Silbersponsor
  • gmc² GmbH Silbersponsor
  • i-refact Silbersponsor
  • initions AG Silbersponsor
  • Lawrence Harvey Silbersponsor
  • linkFISH Consulting GmbH Silbersponsor
  • Lufthansa Industry Solutions Silbersponsor
  • m2data Silbersponsor
  • ORAYLIS GmbH Silbersponsor
  • Passio Consulting Silbersponsor
  • PRODATO Integration Technology GmbH Silbersponsor
  • QuinScape GmbH Silbersponsor
  • Solecon Silbersponsor
  • TCI Consult GmbH Silbersponsor
  • TDWI Young Guns Silbersponsor
  • TEDAMOH Silbersponsor
  • WE ARE DATA Silbersponsor
  • Woodmark Consulting AG Silbersponsor
  • Contiamo Start-Up
  • DataLion GmbH Start-Up
  • iNNOVO Cloud Start-Up
  • SYNABI Start-Up