Skip to content

Commit

Permalink
jsoc: Remove old HPC project ideas (#2220)
Browse files Browse the repository at this point in the history
These aren't valid anymore - I'll add new ones later when I get time.
  • Loading branch information
jpsamaroo authored Jan 19, 2025
1 parent 53ce5c7 commit 455193f
Showing 1 changed file with 0 additions and 16 deletions.
16 changes: 0 additions & 16 deletions jsoc/gsoc/hpc.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,14 +2,6 @@

Julia is emerging as a serious tool for technical computing and is ideally suited for the ever-growing needs of big data analytics. This set of proposed projects addresses specific areas for improvement in analytics algorithms and distributed data management.

## Scheduling Algorithms for Dagger

**Difficulty:** Medium (175h)

Dagger.jl is a native Julia framework and scheduler for distributed execution of Julia code and general purpose data parallelism, using dynamic, runtime-generated task graphs which are flexible enough to describe multiple classes of parallel algorithms. This project proposes to implement different scheduling algorithms for Dagger to optimize scheduling of certain classes of distributed algorithms, such as mapreduce and merge sort, and properly utilizing heterogeneous compute resources. Contributors will be expected to find published distributed scheduling algorithms and implement them on top of the Dagger framework, benchmarking scheduling performance on a variety of micro-benchmarks and real problems.

Mentors: [Julian Samaroo](https://github.com/jpsamaroo), [Krystian Guliński](https://github.com/krynju)

## Distributed Training

**Difficulty:** Hard (350h)
Expand All @@ -21,11 +13,3 @@ There are projects now that host the building blocks: [DaggerFlux.jl](https://gi
**Skills:** Familiarity with UCX, representing execution models as DAGs, Flux.jl, CUDA.jl and data/model parallelism in machine learning

**Mentors:** [Julian Samaroo](https://github.com/jpsamaroo), and [Dhairya Gandhi](https://github.com/DhairyaLGandhi)

## Distributed Arrays over Dagger

**Difficulty:** Medium (175h)

Array programming is possibly the most powerful abstraction in Julia, yet our distributed arrays support leaves much to be desired. This project's goal is to implement a new distributed array type on top of the Dagger.jl framework, which will allow this new array type to be easily distributed, multithreaded, and support GPU execution. Contributors will be expected to implement a variety of operations, such as mapreduce, sorting, slicing, and linear algebra, on top of their distributed array implementation. Final results will include extensive scaling benchmarks on a range of configurations, as well as an extensive test suite for supported operations.

Mentors: [Julian Samaroo](https://github.com/jpsamaroo), [Evelyne Ringoot](https://github.com/evelyne-ringoot)

0 comments on commit 455193f

Please sign in to comment.