TDWI Konferenz 2020

München, 26. – 28. Oktober 2020

Sessionsdetails

Vortrag: Mi 6.1
Datum: Mi, 24.06.2020
Uhrzeit: 09:00 - 10:30
cart

Distributed databases in a microservice architecture environment - project example

Uhrzeit: 09:00 - 10:30
Vortrag: Mi 6.1

 

Using distributed databases across various microservices will be explained based on a research project example. The presentation elaborates of how to achieve data consistency accross microservices, how to communicate using message brokers, how to scale the microservices and achieve application high availability. Container virtualisation and orchestration are technology basis for the solution. The project example show of how to build an Artificial Intelligence (AI) solution - as a service!

Target Audience: Data Engineer, Data Scientist, Project Leader, Architects
Prerequisites: Microservices
Level: Professional

Extended Abstract
Developing microservices has various advantages compared to traditional monolith approach. Loose coupled microservices enables smaller teams to develop independently and using CI/CD on a daily basis. Microservices can be scaled independently using different database technologies optimised for particular use cases. The microservices are fault isolated so particular failures will not result in an overall outage.

But how to ensure data consistency for all distributed databases accross the microservices? How to react on particular failures? And how to interact and communicate between services?

A research project for intelligent energy analysis will be presented. The solution realizes an Artificial Intelligence (AI) solution analyzing streaming data near real time to ensure energy savings in a production environment. The presentation will explain the steps necessary to establish a microservice environment for Artificial Intelligence and Machine Learning. Central logging guarantees operations monitoring accross all microservices. Dashboards presents the results to technical staff monitoring the Machine Learning libraries as well as to the process owner of the domain, e.g. the operations manager or insurance agent. The solution is based on Docker as container virtualisation technology and Kubernetes for container orchestration. In the research project, the solution is realized on premise, but can be easily deployed in the cloud.

 

Sponsoren TDWI München 2020

  • Ab Initio Software Germany GmbH Platinsponsor
  • Adastra GmbH Platinsponsor
  • Data Virtuality GmbH Platinsponsor
  • Denodo Technologies Platinsponsor
  • Exasol Platinsponsor
  • INFOMOTION GmbH Platinsponsor
  • itelligence AG Platinsponsor
  • NTT DATA Deutschland Platinsponsor
  • pmOne Group Platinsponsor
  • Qlik Platinsponsor
  • SAP Deutschland SE & Co. KG Platinsponsor
  • Sopra Steria Platinsponsor
  • Talend Germany GmbH Platinsponsor
  • Teradata GmbH Platinsponsor
  • Trivadis GmbH Platinsponsor
  • 2150 GmbH | Distilling business insight. Goldsponsor
  • adesso AG Goldsponsor
  • Alation Goldsponsor
  • BE-terna GmbH Deutschland Goldsponsor
  • blueforte GmbH Goldsponsor
  • CIMACON GmbH Goldsponsor
  • CP Corporate Planning AG Goldsponsor
  • Dataiku Goldsponsor
  • erwin, Inc. Goldsponsor
  • EVACO GmbH Goldsponsor
  • heureka e-Business GmbH Goldsponsor
  • infologistix GmbH Goldsponsor
  • INFORM DataLab Goldsponsor
  • INFORMATION WORKS GmbH Goldsponsor
  • integration-factory GmbH & Co. KG Goldsponsor
  • Marmeladenbaum GmbH Goldsponsor
  • Neo4j Goldsponsor
  • OPITZ CONSULTING Goldsponsor
  • PROCON IT AG Goldsponsor
  • SYCOR GmbH Goldsponsor
  • Syncwork AG Goldsponsor
  • TIBCO Goldsponsor
  • Vertica Goldsponsor
  • Alligator Company Silbersponsor
  • areto consulting GmbH Silbersponsor
  • Axians IT Solutions GmbH Silbersponsor
  • biGENiUS Silbersponsor
  • bluetelligence GmbH Silbersponsor
  • BSgroup Data Analytics AG Silbersponsor
  • cimt ag Silbersponsor
  • CINTELLIC Consulting Group Silbersponsor
  • Data Insights GmbH Silbersponsor
  • DataMerlin Silbersponsor
  • dataspot GmbH Silbersponsor
  • datasqill - The Post-ETL Silbersponsor
  • Disy Informationssysteme GmbH Silbersponsor
  • DWH42 Silbersponsor
  • Genesee Academy Silbersponsor
  • graphomate GmbH Silbersponsor
  • m2data Silbersponsor
  • PRODATO Integration Technology GmbH Silbersponsor
  • QuinScape GmbH Silbersponsor
  • saracus consulting GmbH Silbersponsor
  • Solecon Silbersponsor
  • sonra Silbersponsor