Workshop on MLOps Systems

To be held along with Third Conference on Machine Learning and Systems (MLSys)

Austin, TX

March 4, 2020

About

Due to the complexity in putting ML into production, the actual machine learning capability is a small part of a complex system and its lifecycle. This new evolving field is known as MLOps. Informally MLOps typically refers to the collaboration between data scientists and operations engineers (e.g. SRE) to manage the lifecycle of ML within an organization. This space is new and has yet to be explored from a research perspective.

In this workshop we aim to cover research problems in MLOps, including the systems and ML challenges involved in this process. We will also cover the software engineering questions including specification, testing and verification of ML software systems. We will bring together a wide variety of experts from both industry and academia, covering persona ranging from data scientists to machine learning engineers.

Call for Papers

We solicit short/position papers (2 pages + references) that will be presented as posters. The page limit includes figures, tables, and appendices, but excludes references. Please use standard LaTeX or Word ACM templates. All submissions will need to be made via EasyChair: submit your paper here.

Topics that are relevant to this workshop include:

  • ML model specification

  • ML model management

  • ML model or Concept drift/change detection

  • ML training pipelines specification, verification

  • ML model monitoring

  • ML model serving techniques and systems

  • ML model specification

  • ML Experiment tracking and management

  • System design for metadata management systems

  • Audits, assurance, security and compliance for MLOps.

  • ML CI/CD

  • Scheduling and Cost Optimization of ML workflows

  • Debugging ML workflows and pipelines

  • Hyperparameter tuning systems

  • MLops for Federated, Split and Distributed Learning



Important dates


Paper submission deadline: January 15, 2020 (submit here)
Author Notification: January 27, 2020
Camera-ready papers due: February 21, 2020
Workshop Date: (tentative) March 4, 2020
All deadlines are at midnight anywhere on earth (AoE), and are firm.

Program

TBA

Organization


Organizing Committee

  • Debo Dutta, Cisco Systems

  • Ce Zhang, ETH Zurich

  • Matei Zaharia, Stanford University & Databricks


Program Committee

  • Debo Dutta, Cisco Systems

  • Ce Zhang, ETH Zurich

  • Matei Zaharia, Stanford University & Databricks