Dr. Qiyang Duan

Alibaba Big Data and Machine Learning Technology

The world's largest shopping festival generates petabytes of data. Discover the integrated big data and AI platform Alibaba built to power its massive e-commerce empire.

Alibaba Big Data and Machine Learning Technology
#1about 4 minutes

How e-commerce scale drives Alibaba's big data technology

Alibaba's big data platform evolved to handle massive transaction volumes from events like the Double 11 festival, processing petabytes of data daily.

#2about 4 minutes

Exploring Alibaba's big data and AI product portfolio

The platform is structured around a typical data flow, including tools for data ingestion, storage, processing, visualization, and a dedicated AI platform called PAI.

#3about 4 minutes

Comparing core data processing engines on Alibaba Cloud

A look at key processing tools including MaxCompute for massive-scale SQL, E-MapReduce for Hadoop migrations, and Flink for real-time stream processing.

#4about 5 minutes

Using DataWorks as a unified IDE for big data

DataWorks provides a single environment for data development and operations, integrating various engines like MaxCompute and Hadoop and including data governance tools.

#5about 7 minutes

Developing models with the Platform for AI (PAI)

The PAI platform supports both visual drag-and-drop model building with PAI Studio and code-based development using the Data Science Workshop (DSW) with JupyterLab.

#6about 2 minutes

Announcing the Alibaba Cloud AI Champion 2020 competition

An overview of the AI Champion 2020 competition, which offers cash prizes and cloud credits for innovative projects built on the PAI platform.

#7about 5 minutes

Live demo of data analysis with DataWorks

A walkthrough of the DataWorks interface, demonstrating how to write and execute SQL queries, visualize results, and manage data integration jobs.

#8about 8 minutes

Live demo of building models on the PAI platform

A demonstration of building a recommendation model using the drag-and-drop PAI Studio and running a deep learning example in the PAI-DSW JupyterLab environment.

Related jobs
Jobs that call for the skills explored in this talk.
SabIna compys

SabIna compys
Vienna, Austria

Remote
20-100K
Intermediate
JavaScript
.NET
+1

Featured Partners

Related Articles

View all articles
CH
Chris Heilmann
All the videos of Halfstack London 2024!
Last month was Halfstack London, a conference about the web, JavaScript and half a dozen other things. We were there to deliver a talk, but also to record all the sessions and we're happy to share them with you. It took a bit as we had to wait for th...
All the videos of Halfstack London 2024!
CH
Chris Heilmann
Dev Digest 116 - WWWAI?
This time, learn how to un-AI Google's search results, what's new on the web, avoid a new security hole and go back to BASICS with us. News and ArticlesWhat a week. Google, Microsoft, OpenAI and many others had their big flagship events announcing th...
Dev Digest 116 - WWWAI?

From learning to earning

Jobs that call for the skills explored in this talk.