Saurabh Bagchi, Purdue University
Kevin Chan, US Army Research Lab
Christof Fetzer, Technische Universität Dresden
Tom Jacobs, Adobe Research
Suman Jana, Columbia University
Prateek Mittal, Princeton University
The workshop will focus on the systems challenges raised by the area of federated (machine) learning, or more generally, distributed learning. In particular, we will focus on how to achieve reliable and secure learning considering that federated learning relies on a distributed set of nodes, often geographically distributed, not physically secured, heterogeneous, and with varying levels of resource constraints. The workshop will lead to a first-of-its-kind vision paper that will synthesize the progress we have made, the overarching technical problems we have to solve, and the 5 most compelling usage scenarios. We will plan on holding this workshop annually, rotating among security and systems venues.
The workshop will have three types of activities:
So far the flourishing work in federated learning in the ML community hints at important systems challenges, which have neither been carefully articulated in a systems forum nor seen concerted solution efforts. Some representative topics for the workshop are (all in the context of federated learning) trusted execution environments, resilience to attacks, intermittent or low bandwidth network connectivity, asynchronous vs synchronous network models, and heterogeneity (devices, data, models). The event will draw academics, government lab scientists, and industrial practitioners.
The key question is can this learning be done reliably and securely so that we can trust our private and critical interactions to such systems.
This pendulum of moving from centralized infrastructure to a distributed infrastructure at the edge has swung at least twice in our living memories and of course, no single point in the spectrum will be the universal solution. The systems community has had a major role in shaping the movement in this arc. This workshop will start the effort to keep the community engaged with an emerging point in the spectrum. The point in the spectrum represented by federated learning seems particularly timely as it leverages two dominant trends in our world: