Parallel and distributed programming

Notes

See also on MSTeams, team code qi1b4q1

Lectures

• 1. Intro
• 2. Handling concurrency
• 3. More concurrency issues
• 4. Higher level multithreading concepts
• 5-6. Futures with continuations
• 7. Simple parallel algorithms
• 8. Advanced recursive decomposition algorithms
• #. Parallel explore algorithms
• #. MPI
• #. Basic distributed protocols
• #. Fault tolerance
• #. OpenCL programming
• Extra. Asyncronous calls and coroutines

Labs

• Lab 1 — "Non-cooperative" multi-threading
• Lab 2 — Producer-consumer synchronization
• Lab 3 — Simple parallel tasks
• Lab 4 — Futures and continuations
• Lab 5 — Parallelizing techniques
• Lab 6 — Parallelizing techniques (2 - parallel explore)
• Lab 7 — MPI programming
• Lab 8 — Distributed protocols
• Optional (bonus) lab 1 — OpenCL programming

Project themes

List of ideas for project themes

Requirements and grading

Documents from previous years

Old labs

• Lab 4 — Complex synchronization
• Lab 7 — Parallelizing techniques (2)

Old seminary notes

• 1. Simple mutual exclusion
• 2. Complex exclusion + producer-consumer
• 3. Advanced producer-consumer + simple parallelism
• 4. Designing parallel programs
• 5.
• 6.
• 7. Revision - futures