Code

add all-reduce for MPI, NCCL, and RCCL#8

Code

Open

adistomar wants to merge 20 commits intohpcgroup:develophpcgroup/gpu-benchmarks:developfrom adistomar:allreduceadistomar/gpu-benchmarks:allreduceCopy head branch name to clipboard

+325-34

Commits

Commits on Mar 26, 2024

• add cudaDeviceSynchronize for NCCL

  adistomar

  committed
  f7fb83c

  Copy full SHA for f7fb83c

Commits on Mar 30, 2024

• add allreduce code

  adistomar

  committed
  453a397

  Copy full SHA for 453a397

• Merge branch 'hpcgroup:develop' into develop

  adistomar

  authored
  32c1211

  Copy full SHA for 32c1211

Commits on Apr 1, 2024

• add code for ROCm and RCCL

  adistomar

  committed
  982ccaf

  Copy full SHA for 982ccaf

• revert Makefile to original

  adistomar

  committed
  8ab25d1

  Copy full SHA for 8ab25d1

• remove unneeded import

  adistomar

  committed
  ef65ccd

  Copy full SHA for ef65ccd

• add ROCm and RCCL code for all-reduce

  adistomar

  committed
  795a6d3

  Copy full SHA for 795a6d3

• revert Makefile to original

  adistomar

  committed
  4a87dfc

  Copy full SHA for 4a87dfc

• revert Makefile to original

  adistomar

  committed
  b6083d1

  Copy full SHA for b6083d1

• update custom bf16 sum function

  adistomar

  committed
  79b2fb9

  Copy full SHA for 79b2fb9

• fix custom bf16 sum function

  adistomar

  committed
  ef6fb0d

  Copy full SHA for ef6fb0d

• fix indents

  adistomar

  committed
  8052ca7

  Copy full SHA for 8052ca7

Commits on Apr 11, 2024

• Merge pull request #1 from RoastSea8/allreduce

  Show description for b04e902
  adistomar

  authored
  b04e902

  Copy full SHA for b04e902

• Merge pull request #2 from RoastSea8/rccl-all-gather

  Show description for 73c53dc
  adistomar

  authored
  73c53dc

  Copy full SHA for 73c53dc

Commits on Apr 13, 2024

• change to int64_t for global/local data size

  adistomar

  committed
  abc811f

  Copy full SHA for abc811f

• revert type change for custom sum

  adistomar

  committed
  b25520e

  Copy full SHA for b25520e

Commits on Apr 14, 2024

• change atoi to strtoll

  adistomar

  committed
  d2954f9

  Copy full SHA for d2954f9

• Merge branch 'allreduce' of https://github.com/RoastSea8/gpu-benchmarks into allreduce

  adistomar

  committed
  e6d906b

  Copy full SHA for e6d906b

• add hip directive

  adistomar

  committed
  aa8e516

  Copy full SHA for aa8e516

Commits on Apr 26, 2024

• update

  adistomar

  committed
  e841fe4

  Copy full SHA for e841fe4