Skip to content

v1.1 (May 10 2022) - Active Messages Protocol
Compare
Choose a tag to compare
@github-actions github-actions released this 09 May 11:41
· 8 commits to master since this release
v1.1
04bda24
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
  • Switch transport protocol from one-sided API to Active Messages.
  • Data is being read from disk into pre-registered bounce buffers, allowing to work with a shuffle of size, bigger than memory.
  • SparkUCX shuffle now uses generic API (registerBlock, fetchBlocksByBockId), to abstract and hide actual transport implementation.
  • Added standalone performance benchmark, to test shuffle bandwidth between 2 processes without setup spark cluster.
Assets 4
Loading