View More DetailsRegistration

The schedule is subject to change.

Please note: This schedule is automatically displayed in Central European Summer Time (CEST). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above “Filter by Date.”
Back To Schedule
Monday, August 17 • 15:10 - 15:40
Serverless Machine Learning Inference with KFServing - Clive Cox, Seldon & Yuzhui Liu, Bloomberg

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Putting machine learning models into production is a challenging task for data scientists and devops within an organization. In this talk we will discuss how KFServing builds on top of the KNative project to provide serverless machine learning inference. It provides simple abstractions for deploying standard and custom machine learning models and updating them via canaries. Serverless technology helps to provide painless auto-scaling and scale to zero functionality over complex GPU and CPU based components. However, serverless and machine learning inference do have their challenges especially in latency critical environments and we will discuss some of those challenges as well as the future prospects for the use of serverless within machine learning.

avatar for Yuzhui Liu

Yuzhui Liu

Team Lead, Bloomberg
Yuzhui Liu leads the Data Science Runtime team at Bloomberg. Her team manages an on-prem Kubernetes-based machine learning infrastructure that is used to address Bloomberg’s evolving data science needs. She is actively involved in the Kubernetes open source ecosystem as both a contributor... Read More →
avatar for Clive Cox

Clive Cox

CTO, Seldon
Clive is CTO of Seldon. Seldon helps enterprises put machine learning into production. Clive developed Seldon's open source Kubernetes based machine learning deployment platform Seldon Core. He is also a core contributor to the Kubeflow and KFServing projects.

Monday August 17, 2020 15:10 - 15:40 CEST
InXpo https://onlinexperiences.com/Launch/Event.htm?ShowKey=99259