The MPI Operator makes it easy to run allreduce-style distributed training on Kubernetes. Please check out this blog post for an introduction to MPI Operator and its industry adoption - https://www.kubeflow.org/docs/components/training/mpi/
To install the MPI operator simply type: