(CMP310) Building Robust Data Processing Pipelines Using Containers and Spot Instances | AWS re:Invent 2015

(CMP310) Building Robust Data Processing Pipelines Using Containers and Spot Instances | AWS re:Invent 2015

Released Friday, 9th October 2015
Good episode? Give it some love!
(CMP310) Building Robust Data Processing Pipelines Using Containers and Spot Instances | AWS re:Invent 2015

(CMP310) Building Robust Data Processing Pipelines Using Containers and Spot Instances | AWS re:Invent 2015

(CMP310) Building Robust Data Processing Pipelines Using Containers and Spot Instances | AWS re:Invent 2015

(CMP310) Building Robust Data Processing Pipelines Using Containers and Spot Instances | AWS re:Invent 2015

Friday, 9th October 2015
Good episode? Give it some love!
Rate Episode
List
It's difficult to find off-the-shelf, open-source solutions for creating lean, simple, and language-agnostic data-processing pipelines for machine learning (ML). This session shows you how to use Amazon S3, Docker, Amazon EC2, Auto Scaling, and a number of open source libraries as cornerstones to build one. We also share our experience creating elastically scalable and robust ML infrastructure leveraging the Spot instance market.
Show More