Code

[WIP] Device tasks with coroutines#253

Code

Merged

evaleev merged 83 commits intoTESSEorg:masterTESSEorg/ttg:masterfrom devreal:ttg-device-support-master-corodevreal/ttg:ttg-device-support-master-coroCopy head branch name to clipboardFeb 27, 2024

+8,462-799

Commits

Commits on Jul 6, 2023

• Mock of ttg::make_device_tt and views

  Show description for 835955e
  devreal

  committed
  835955e

  Copy full SHA for 835955e

• Add new header to CMake files

  Show description for 7b6319b
  devreal

  committed
  7b6319b

  Copy full SHA for 7b6319b

• Add device_mock example to compile the ttg device mock API

  Show description for 25d8c3c
  devreal

  committed
  25d8c3c

  Copy full SHA for 25d8c3c

• [example/device_mock] added missing #include

  

  evaleev

  authored and

  devreal

  committed
  831bc0f

  Copy full SHA for 831bc0f

• [example/device_mock] declare as off-limits to clang-format

  

  evaleev

  authored and

  devreal

  committed
  5618e86

  Copy full SHA for 5618e86

• [example/device_mock] cleanup

  

  evaleev

  authored and

  devreal

  committed
  1e8fb69

  Copy full SHA for 1e8fb69

• Partial implementation of ttg::make_device_tt

  Show description for 4d2b937
  devreal

  committed
  4d2b937

  Copy full SHA for 4d2b937

• make device_mock compile again, and no need for MAWworld for no reason

  

  evaleev

  authored and

  devreal

  committed
  11c4d4d

  Copy full SHA for 11c4d4d

• Encapsulate callables passed to make_device_tt mock in a regular task

  Show description for fa6359a
  devreal

  committed
  fa6359a

  Copy full SHA for fa6359a

• Use the new multiindex key type in device mock example

  Show description for 0317069
  devreal

  committed
  0317069

  Copy full SHA for 0317069

• Remove superfluous todos

  Show description for ffef761
  devreal

  committed
  ffef761

  Copy full SHA for ffef761

• Provide a scope for views and replace ttg::span with ttg::ViewSpan

  Show description for 65668f4
  devreal

  committed
  65668f4

  Copy full SHA for 65668f4

• Add missing view include in madness backend

  Show description for 6f5e782
  devreal

  committed
  6f5e782

  Copy full SHA for 6f5e782

• Rename CUDA precompile guards:

  Show description for 7510b54
  devreal

  committed
  7510b54

  Copy full SHA for 7510b54

• Remove noexcept from from default View ctor

  Show description for de2ad29
  devreal

  committed
  de2ad29

  Copy full SHA for de2ad29

• Add missing terminal name in mock device example

  Show description for 3c2186b
  devreal

  committed
  3c2186b

  Copy full SHA for 3c2186b

• Add a fence to the mock device test to make the termdet happy

  Show description for a04a434
  devreal

  committed
  a04a434

  Copy full SHA for a04a434

• Add iovec.h to list of installed files.

  Show description for de0d3c4
  devreal

  committed
  de0d3c4

  Copy full SHA for de0d3c4

• slight reorg of contrib dox + added device design notes

  

  evaleev

  authored and

  devreal

  committed
  d26b43e

  Copy full SHA for d26b43e

• updated device design notes to point out the need for Views in both UM and DM models

  

  evaleev

  authored and

  devreal

  committed
  816b6f2

  Copy full SHA for 816b6f2

• make TTG compilable with C++20

  

  evaleev

  authored and

  devreal

  committed
  ace8e17

  Copy full SHA for ace8e17

• avoid infinite recursion in ttg::{set_size,finalize}<i> that do not take outterm as an argument

  

  evaleev

  authored and

  devreal

  committed
  b59677a

  Copy full SHA for b59677a

• ttg_parsec::TT::static_op{,_noarg} return parsec_hook_return_t in preparation for suspendable tasks

  

  evaleev

  authored and

  devreal

  committed
  557c423

  Copy full SHA for 557c423

• cleanup

  

  evaleev

  authored and

  devreal

  committed
  aa7c1b7

  Copy full SHA for aa7c1b7

• find <coroutine>

  

  evaleev

  authored and

  devreal

  committed
  302b745

  Copy full SHA for 302b745

• added an example of a task body being a (trivial) coroutine

  

  evaleev

  authored and

  devreal

  committed
  402e47d

  Copy full SHA for 402e47d

• [ci] try using gcc-10, first to provide support C++ corotuines, for ubuntu runners

  

  evaleev

  authored and

  devreal

  committed
  76b52bd

  Copy full SHA for 76b52bd

• [ci] try dumping CMake{Output,Error}.log if cmake fails

  

  evaleev

  authored and

  devreal

  committed
  3284457

  Copy full SHA for 3284457

• coroutines are optional, but CI will try to use them

  

  evaleev

  authored and

  devreal

  committed
  0599432

  Copy full SHA for 0599432

• gcc-12 does not seem to like co_return in a function returning void

  

  evaleev

  authored and

  devreal

  committed
  96b19aa

  Copy full SHA for 96b19aa

• updated design notes w/ tentative coroutine-based sketch

  

  evaleev

  authored and

  devreal

  committed
  1b32e81

  Copy full SHA for 1b32e81

• started sketching out resumable_task

  

  evaleev

  authored and

  devreal

  committed
  ca6ba97

  Copy full SHA for ca6ba97

• resumable_task is starting to come together, trivial co_await works

  

  evaleev

  authored and

  devreal

  committed
  6cbb604

  Copy full SHA for 6cbb604

• moar resumable_task ... final_suspend always suspends to avoid coros that never suspend

  

  evaleev

  authored and

  devreal

  committed
  0467ab8

  Copy full SHA for 0467ab8

• implemented introspection of return type of generic/non-generic callables

  

  evaleev

  authored and

  devreal

  committed
  c7fcef8

  Copy full SHA for c7fcef8

• fixup

  

  evaleev

  authored and

  devreal

  committed
  dc077e0

  Copy full SHA for dc077e0

• make_tt extracts return type name from the callable

  

  evaleev

  authored and

  devreal

  committed
  7a94b9e

  Copy full SHA for 7a94b9e

• return type propagated further up the call stack to allow proper support for coroutines

  Show description for 4f3e376
  

  evaleev

  authored and

  devreal

  committed
  4f3e376

  Copy full SHA for 4f3e376

• ttg_parsec::TT::static_op now receives nonnull ptr to the coroutine state, if it suspended, ready to implement logic for dealing with suspended coroutines

  

  evaleev

  authored and

  devreal

  committed
  ba15731

  Copy full SHA for ba15731

• sketch out resuming suspended task in the parsec backend

  

  evaleev

  authored and

  devreal

  committed
  c920334

  Copy full SHA for c920334

• parsec reruns suspended tasks successfully

  Show description for 02c4e3e
  

  evaleev

  authored and

  devreal

  committed
  02c4e3e

  Copy full SHA for 02c4e3e

• cleanup + updated design notes

  

  evaleev

  authored and

  devreal

  committed
  943f664

  Copy full SHA for 943f664

• cleanup + annotation of of the coroutine classes + cleanup of the PaRSEC implementation

  Show description for 63195c4
  

  evaleev

  authored and

  devreal

  committed
  63195c4

  Copy full SHA for 63195c4

• parsec's TT::static_op_noarg now is also coroutine aware

  

  evaleev

  authored and

  devreal

  committed
  e2e3b2b

  Copy full SHA for e2e3b2b

• adapted madness backend to do same (incomplete) handling of coroutines as in parsec. enough for proof of concept.

  Show description for 5c6b316
  

  evaleev

  authored and

  devreal

  committed
  5c6b316

  Copy full SHA for 5c6b316

• fixups to make build with C++17 again

  

  evaleev

  authored and

  devreal

  committed
  16f45bc

  Copy full SHA for 16f45bc

• [cmake] fixup

  

  evaleev

  authored and

  devreal

  committed
  7adf428

  Copy full SHA for 7adf428

• replaced more std::abort instances with ttg::abort

  

  evaleev

  authored and

  devreal

  committed
  59e19bf

  Copy full SHA for 59e19bf

• make MultiIndex mad/boost-serializable

  

  evaleev

  authored and

  devreal

  committed
  325dcab

  Copy full SHA for 325dcab

• [ci] C compiler matches C++ compiler

  

  evaleev

  authored and

  devreal

  committed
  779d397

  Copy full SHA for 779d397

• [cmake] discover std::coroutine is needed

  

  evaleev

  authored and

  devreal

  committed
  7206c61

  Copy full SHA for 7206c61

• [cmake] install public headers generated in the build tree correctly

  

  evaleev

  authored and

  devreal

  committed
  72d2919

  Copy full SHA for 72d2919

• [ci] dump CMake{Output,Error}.log of install tree tests to CI log

  

  evaleev

  authored and

  devreal

  committed
  b3111c2

  Copy full SHA for b3111c2

• [cmake] when checking for std coroutine header try without and with -std flags to try to enable c++20

  

  evaleev

  authored and

  devreal

  committed
  adaf4e5

  Copy full SHA for adaf4e5

• [cmake] when compiling std coroutine example try without and with -std flags to try to enable c++20

  

  evaleev

  authored and

  devreal

  committed
  419192c

  Copy full SHA for 419192c

• [cmake] do not do separate header and compile checks for coroutine does not work (headers may be present but not usable, etc.)

  

  evaleev

  authored and

  devreal

  committed
  8e9a16f

  Copy full SHA for 8e9a16f

• Initial implementation of coroutine-based device support with PaRSEC

  Show description for 9fd5b87
  devreal

  committed
  9fd5b87

  Copy full SHA for 9fd5b87

• Compiler fixes

  Show description for 3fe08a8
  devreal

  committed
  3fe08a8

  Copy full SHA for 3fe08a8

• Add device_coro.cc test file

  Show description for 78785a1
  devreal

  committed
  78785a1

  Copy full SHA for 78785a1

• Some more device coroutine examples

  Show description for d7893df
  devreal

  committed
  d7893df

  Copy full SHA for d7893df

• Base of the beginning to log the appropriate info from the profiling

  

  therault

  authored and

  devreal

  committed
  7a17baf

  Copy full SHA for 7a17baf

• Update to appropriate version of parsec; use arrays of chars to store the key in the profiling info under the parsec driver

  

  therault

  authored and

  devreal

  committed
  cbb30b6

  Copy full SHA for cbb30b6

• Port deprecated types and functions to parsec master

  

  therault

  authored and

  devreal

  committed
  cc12ba2

  Copy full SHA for cc12ba2

• Port the PaRSEC backend over a candidate PaRSEC master

  

  therault

  authored and

  devreal

  committed
  078ad46

  Copy full SHA for 078ad46

• Make device coro tasks actually compile

  Show description for a2caac6
  devreal

  committed
  a2caac6

  Copy full SHA for a2caac6

• Many fixes to coro-based device tasks

  Show description for 8cc11a6
  devreal

  committed
  8cc11a6

  Copy full SHA for 8cc11a6

• Clean up code from ttg::meta::is_detected debugging

  devreal

  committed
  82c2a89

  Copy full SHA for 82c2a89

• Clean up code from ttg::meta::is_detected debugging

  Show description for 5df8350
  devreal

  committed
  5df8350

  Copy full SHA for 5df8350

• Implement ttg::buffer and ttg::devicescratch in the PaRSEC backend

  Show description for e0c0b78
  devreal

  committed
  e0c0b78

  Copy full SHA for e0c0b78

• Support for moving between device and host tasks, much more

  Show description for 93a7dc5
  devreal

  committed
  93a7dc5

  Copy full SHA for 93a7dc5

• get_ptr is not an awaitable operation

  Show description for 542afc2
  devreal

  committed
  542afc2

  Copy full SHA for 542afc2

• Extend CUDA test and add support for sending objects containing a buffer

  devreal

  committed
  53fd5f7

  Copy full SHA for 53fd5f7

• Fix msg header ctor and non-device tasks

  Show description for c6b0416
  devreal

  committed
  c6b0416

  Copy full SHA for c6b0416

• Draft for sending out of a device task

  Show description for b9b7bdb
  devreal

  committed
  b9b7bdb

  Copy full SHA for b9b7bdb

• compile fixups for clang (N.B. clang is still unusable due to missing std::atomic_ref in libc++)

  

  evaleev

  authored and

  devreal

  committed
  514acf8

  Copy full SHA for 514acf8

• Wrap various C/C++-only options using language-specific generator expressions to avoid pissing CUDA off

  

  evaleev

  authored and

  devreal

  committed
  0c889ba

  Copy full SHA for 0c889ba

• make ttg::buffer and device_coro's value_t serializable by boost

  

  evaleev

  authored and

  devreal

  committed
  8094854

  Copy full SHA for 8094854

• CUDA tests: increment scratch buffer if provided

  Show description for 96e0d67
  devreal

  committed
  96e0d67

  Copy full SHA for 96e0d67

• Disable catching POSIX signals in Catch2 tests

  Show description for 71f123c
  devreal

  committed
  71f123c

  Copy full SHA for 71f123c

• Make CUDA tasks work in distributed, incl tests

  devreal

  committed
  4b6970a

  Copy full SHA for 4b6970a

• CUDA version of BSPMM

  Show description for 19adc69
  devreal

  committed
  19adc69

  Copy full SHA for 19adc69

• Call cublasDgemm with the right arguments

  devreal

  committed
  26341dc

  Copy full SHA for 26341dc

• SPMM: make CUDA version work

  Show description for 8362742
  devreal

  committed
  8362742

  Copy full SHA for 8362742