Report

Roter Faden

• We try to solve a distributed outer product
• First attempt:
  • Naive allgather
  • Naive allreduce
  • -> Works decently well
• Second attempt
  • Look at various implementations of the decision tree
  • Optimize them, specifically targeted at our initial problem
  • -> Successful mainly for both ring (attempt to beat native-ring) and g-rabenseifner
• Future work
  • Push to upstream MPI implementation (if possible)
  • Take network topology into consideration

Table of Content

Abstract

• What do we want to solve
• Why is it a problem
• How do we solve it

Introduction

• Start from birds-eye view (solving NN)
• Zoom into the detailed problem (send around chunks of data)

Background

• MPI Library
• https://web.cels.anl.gov/~thakur/papers/ijhpca-coll.pdf
• What else?

Related Work

Implementation

Experimental Results

Conclusion

Future Work

References