Skip to content

Commit ecb4301

Browse files
committed
filling in some intro material
1 parent 6ec74ec commit ecb4301

File tree

1 file changed

+53
-14
lines changed

1 file changed

+53
-14
lines changed

rfcs/20200427-tff-aggregators-placement.md

+53-14
Original file line numberDiff line numberDiff line change
@@ -6,40 +6,79 @@
66
| **Author(s)** | Jason Mancuso ([email protected]) |
77
| **Sponsor** | Michael Reneer ([email protected]) |
88
| **Updated** | YYYY-MM-DD (TODO) |
9-
| **Obsoletes** | TF-RFC it replaces, else remove this header |
109

1110
## Objective
1211

13-
What are we doing and why? What problem will this solve? What are the goals and
14-
non-goals? This is your executive summary; keep it short, elaborate below.
15-
Add an explicit placement for Aggregators to the TensorFlow Federated Core.
12+
This document proposes adding an explicit `tff.AGGREGATORS` placement to the
13+
Federated Core (FC) in TensorFlow Federated (TFF). This would allow users to express
14+
custom aggregation protocols directly in TFF without adding unnecessary
15+
assumptions about where aggregation functions must be placed and computed.
1616

1717
## Motivation
1818

19-
Why this is a valuable problem to solve? What background information is needed
20-
to show how this design addresses the problem?
21-
22-
Which users are affected by the problem? Why is it a problem? What data supports
23-
this? What related work exists?
19+
*Why this is a valuable problem to solve? What background information is needed
20+
to show how this design addresses the problem?*
21+
22+
When approaching federated learning with an eye for security or privacy, it is
23+
useful to divide federated computation into two categories: computations performing
24+
aggregations, and computations performing on-device computation. Security and
25+
privacy issues tend to show up during the aggregation phase. This is particularly
26+
clear when looking at common methods of adding security guarantees to traditional,
27+
parameter-server style federated learning, for example with secure aggregation or
28+
differentially private federated averaging (DP-FedAvg).
29+
30+
In security-heightened settings, it is often worthwhile to separate computation
31+
done in this aggregation phase from computation performed by the server in the
32+
traditional parameter server setup. This amounts to delegating aggregations to a
33+
third-party service. For example, when the clients are mistrustful of the server,
34+
aggregations might be delegated to a trusted execution environment or to a cluster
35+
of machines engaging in a secure multi-party computation protocol. Another example
36+
is secure aggregation in the
37+
[Encode-Shuffle-Analyze (ESA)](https://arxiv.org/abs/1710.00901)
38+
model, which in a federated context generally assumes an additional
39+
party to perform the secure shuffling needed to realize a differential privacy
40+
guarantee. Since this is an established area of the literature with strong
41+
motivations and results, we see this as an important line of work for TFF to
42+
support in order to keep with its
43+
[project goals](https://github.com/tensorflow/federated#tensorflow-federated).
44+
45+
In general, any secure aggregation protocol can be represented as a coordinated
46+
computation between three groups of parties: a server, a (potentially singleton)
47+
set of aggregators, and a set of clients. Note that these need not be mutually
48+
exclusive, so for example the traditional parameter server setting can be recovered
49+
as a special case by treating the server as a singleton aggregators set.
50+
51+
The TFF Federated Core (FC) language currently realizes logically-distinct parties
52+
as "placements". While there exist `tff.SERVER` and `tff.CLIENTS` placements in FC,
53+
there is no `tff.AGGREGATORS` placement. Without such a placement, implementing new
54+
aggregation protocols in TFF can require low-level programming of the TFF executor
55+
stacks, as evidenced by
56+
[this community attempt to integrate secure aggregation](https://github.com/tf-encrypted/rfcs/blob/master/20190924-tensorflow-federated/integration-strategies.md).
57+
By adding a `tff.AGGREGATORS` placement, users can more easily implement new
58+
aggregation protocols by expressing them as federated computations in FC.
2459

2560
## User Benefit
2661

27-
How will users (or other contributors) benefit from this work? What would be the
28-
headline in the release notes or blog post?
62+
*How will users (or other contributors) benefit from this work? What would be the
63+
headline in the release notes or blog post?*
64+
65+
Users can now express custom aggregation protocols in the Federated Core by working
66+
with federated data placed on `tff.AGGREGATORS`. Users will be unencumbered by the
67+
constraints of the current federated types in FC.
2968

3069
## Design Proposal
3170

32-
This is the meat of the document, where you explain your proposal. If you have
71+
*This is the meat of the document, where you explain your proposal. If you have
3372
multiple alternatives, be sure to use sub-sections for better separation of the
3473
idea, and list pros/cons to each approach. If there are alternatives that you
3574
have eliminated, you should also list those here, and explain why you believe
3675
your chosen approach is superior.
3776

38-
Make sure you’ve thought through and addressed the following sections. If a section is not relevant to your specific proposal, please explain why, e.g. your RFC addresses a convention or process, not an API.
77+
Make sure you’ve thought through and addressed the following sections. If a section is not relevant to your specific proposal, please explain why, e.g. your RFC addresses a convention or process, not an API.*
3978

4079

4180
### Alternatives Considered
42-
* Make sure to discuss the relative merits of alternatives to your proposal.
81+
A lower effort alternative might be to expect users to write custom executors, or custom executor stacks, to include additional "aggregator" parties when executing intrinisics. AGGREGATORS would stay outside of the FC type system, but could be sill be included in federated computations. This allows library designers to extend TFF for their own use cases. This is a major disadvantage, since users are only expected to be familiar with TFF Federated Learning (FL) or FC APIs, and this is a feature that would be useful to the majority of TFF users.
4382

4483
### Performance Implications
4584
* Do you expect any (speed / memory)? How will you confirm?

0 commit comments

Comments
 (0)