Dubravko Dolic & Hüdaverdi Cakir
Industrializing your Data Science capabilities
#1about 2 minutes
The challenge of industrializing data science models
A tire recall incident highlights the gap between a data scientist's local Python script and a scalable, production-ready solution.
#2about 3 minutes
Building the initial concept for a data science factory
The journey began with a demand forecasting use case, leading to the concept of a lab for experimentation and a factory for industrialization.
#3about 5 minutes
Establishing processes and a cloud-agnostic tool stack
A standardized process with dev, QA, and prod stages was created, supported by a cloud-agnostic tool stack including Git, Jenkins, and Kubernetes.
#4about 5 minutes
Technical architecture for a multi-stage deployment environment
The architecture uses Kubernetes and containerization to create reproducible dev, QA, and prod environments with immutable builds and stage-specific configurations.
#5about 11 minutes
Live demo of deploying and promoting application versions
A command-line interface is used to deploy a new version of a Shiny application to the dev environment and promote an existing build from dev to QA.
#6about 5 minutes
Monitoring applications with logs and metrics
The platform provides developers with access to Elastic Stack for log aggregation and Prometheus with Grafana for metrics to monitor application performance.
#7about 2 minutes
Providing a simplified lab environment for data scientists
A web-based frontend offers pre-configured templates for RStudio and Python, abstracting away infrastructure complexity for data scientists.
#8about 4 minutes
Real-world use cases from tire manufacturing
Several applications are showcased, including real-time tire monitoring for mining trucks, optimizing material mixing, and deploying scrap prediction models to edge devices.
#9about 6 minutes
Integrating the factory into a larger analytics ecosystem
The Data Science Factory is part of a broader ecosystem that includes a telemetry backbone, image recognition pipelines, and predictive maintenance platforms.
Related jobs
Jobs that call for the skills explored in this talk.
Matching moments
01:55 MIN
Merging data engineering and DevOps for scalability
Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure
10:54 MIN
Managing massive data scales with the Robotic Drive platform
How to develop an autonomous car end-to-end: Robotic Drive and the mobility revolution
01:29 MIN
Overview of the data and machine learning tech stack
Empowering Retail Through Applied Machine Learning
02:34 MIN
Bridging gaps with DevOps and containerization
From Punch Cards to AI-assisted Development
02:18 MIN
Using data management and open source tools for MLOps
MLOps - What’s the deal behind it?
04:25 MIN
From research concepts to production-ready data products
Implementing continuous delivery in a data processing pipeline
01:43 MIN
Defining the roles of data scientists and MLOps engineers
How E.On productionizes its AI model & Implementation of Secure Generative AI.
02:49 MIN
Q&A: MLOps tools for building CI/CD pipelines
Data Science in Retail
Featured Partners
Related Videos
DevOps for Machine Learning
Hauke Brammer
Big Business, Big Barriers? Stress-Testing AI Initiatives.
Marin Niehues
Implementing continuous delivery in a data processing pipeline
Álvaro Martín Lozano
Developer Experience, Platform Engineering and AI powered Apps
Ignacio Riesgo & Natale Vinto
DataForce Studio
Iryna Kondrashchenko & Oleh Kostromin
Effective Machine Learning - Managing Complexity with MLOps
Simon Stiebellehner
Empowering Thousands of Developers: Our Journey to an Internal Developer Platform
Bastian Heilemann & Bruno Margula
AI beyond the code: Master your organisational AI implementation.
Marin Niehues
Related Articles
View all articles
.gif?w=240&auto=compress,format)


From learning to earning
Jobs that call for the skills explored in this talk.





SYSKRON GmbH
Regensburg, Germany
Intermediate
Senior
.NET
Python
Kubernetes

evoila Frankfurt GmbH
Mainz, Germany
Intermediate
Senior
Kubernetes


