Overview
The purpose of this course is to introduce students to parallel programming. By the end of the course students will be able to design and implement working parallel programs in traditional (e.g., Java Threads) and emerging parallel programming models. Moreover, students will master fundamental concepts in parallelism and be able to reason about the correctness, performance, and the construction of parallel programs using different parallel programming paradigms (e.g., task parallelism, data parallelism) and mechanisms (e.g., threads, tasks, locks, communication channels). Finally, the course will examine how parallel programming methodologies can be applied in different algorithmic domains by investigating parallelization of algorithms.
Topics include:
Announcements
- 31.07.2015
- Errata and Remarks document available here
- 07.05.2015
- Updated nqueens saveBoard() function in assignment11.zip so it is thread-safe.
- 24.04.2015
- Updated SequentialList.java in assignment9.zip hand-out to clarify the assignment.
- 24.04.2015
- Information about Midterm review added.
- 13.04.2015
- Midterm grades published.
- 30.03.2015
- PP-l13-LocksRaces_annotated.pdf uploaded which contains a clarification regarding Amdahl and Gustafson Law.
- 26.03.2015
- Corrected Exercise numbers in assignment 6 slides.
- 25.03.2015
- Midterm informations added.
- 05.03.2015
- Exercise 3 hand-out updated with minor corrections.
- 04.03.2015
- Exercise 3 is now online.
- 25.02.2015
- Exercise 2 is now online.
- 24.02.2015
- Slides of 23.03 updated with minor corrections for Slide 53 and 55.
- 18.02.2015
- Exercise 1 is now online.
- 11.02.2015
- Course Website for Spring 2015 online.
Course Content
Main text and reference book
Related resources, text and reference books
Introduction to Java books (freely available)
OpenCL
Schedule
| Wk. | Date | Content | Slides |
|---|---|---|---|
| 1 | 16.02.2015 | Course Introduction |
Slides |
| 1 | 17.02.2015 | Introduction to Programming |
Slides Slides (annotated) Code |
| 2 | 23.02.2015 | Java Basics I (Programming in the Small) |
Slides Slides (annotated) Code |
| 2 | 24.02.2015 | Java Basics II (Programming in the Large) |
Slides Slides (annotated) Code |
| 3 | 02.03.2015 | Java Basics III (Programming in the Large II) |
Slides Slides (annotated) Code |
| 3 | 03.03.2015 | Java Basics IV (Threads) |
Slides Slides (annotated) Code |
| 4 | 09.03.2015 | Parallel Architectures |
Slides Slides (annotated) |
| 4 | 10.03.2015 | Basic Parallelism Concepts |
Slides Slides (annotated) |
| 5 | 16.03.2015 | Parallel Models |
Slides Slides (annotated) |
| 5 | 17.03.2015 | Introduction to Task Parallelism |
Slides Code |
| 6 | 23.03.2015 | Task Parallelism in Java |
Slides Slides (annotated) Code |
| 6 | 24.03.2015 | Shared Memory Concurrency, Mutual exclusion, Locks |
Slides Slides (annotated) |
| 7 | 30.03.2015 | Synchronization: Locks and Data Races |
Slides Slides (annotated) |
| 7 | 31.03.2015 | !! Midterm Exam !! |
|
| 8 | 13.04.2015 | Synchronization: Beyond locks I |
Slides Slides (as presented) Code |
| 8 | 14.04.2015 | Synchronization: Beyond locks II |
Slides Slides (as presented) Code |
| 9 | 20.04.2015 | Synchronization: Behind Locks |
Slides Slides (as presented) Code |
| 9 | 21.04.2015 | Synchronization: Without Locks |
Slides Slides (as presented) Code |
| 10 | 27.04.2015 | A bit of Concurrency Theory |
Slides Slides (as presented) |
| 10 | 28.04.2015 | C sequential: from Java to C |
Slides Slides (as presented) Code |
| 11 | 04.05.2015 | C parallel: OpenMP |
Slides Slides (as presented) Code |
| 11 | 05.05.2015 | C parallel: OpenMP / MPI |
Slides Slides (as presented) Code |
| 12 | 11.05.2015 | MPI / Introduction to GPGPU Computing |
Slides Slides (as presented) |
| 12 | 12.05.2015 | Introduction to OpenCL |
Slides Slides (as presented) Code |
| 13 | 18.05.2015 | OpenCL: Memory Model and Synchronisation |
Slides Slides(as presented) Code |
| 13 | 19.05.2015 | OpenCL: Case Studies |
Slides Slides (as presented) Code |
| 14 | 26.05.2015 | Recap / Q&A Session |
Conclusion |
Exercises
| Exercise | Assignment | Due date |
|---|---|---|
| Exercise 1 | Handout Slides | 25.02.2015 |
| Exercise 2 | Handout Slides assignment2.zip solution2.zip | 04.03.2015 |
| Exercise 3 | Handout Slides assignment3.zip solution3.zip | 11.03.2015 |
| Exercise 4 | Handout Slides assignment4.zip threaddemo.zip Solution solution4.zip [new] | 18.03.2015 |
| Exercise 5 | Handout Slides Solution | 25.03.2015 |
| Exercise 6 | Handout assignment6.zip Slides [updated] Solution solution6.zip | 01.04.2015 |
| Exercise 7 | Handout assignment7.zip Solution [updated] solution7.zip | 15.04.2015 |
| Exercise 8 | Handout assignment8.zip Slides Solution solution8.zip | 22.04.2015 |
| Exercise 9 | Handout assignment9.zip [updated] Slides solution9.zip | 29.04.2015 |
| Exercise 10 | Handout assignment10.zip Slides solution10.zip | 06.05.2015 |
| Exercise 11 | Handout assignment11.zip Slides solution11.zip | 13.05.2015 |
| Exercise 12 | Handout assignment12.zip Slides solution12.zip | 20.05.2015 |
| Exercise 13 | Handout assignment13.zip solution13.zip | 03.05.2015 |
Exams and Grading
Class is part of Basisprüfung. There is a written, centralized exam after the end of the semester.
Exercise sessions are not graded, however they are considered essential!
Midterm Exam
There will be one midterm on the 31.03.15. The midterm is during the lecture hours (10:15 − 12:00) and closed book. No additional material is allowed.
The midterm will take place in three different rooms, please come directly to the correct room according to your last name.
- HG E7: Lastname starting with A - H
- HG F3: Lastname starting with I - P
- ETF E1: Lastname starting with R - Z
Midterm Material
Relevant for the midterm are exercises 1 to (and including) 6 and the lectures from 16.02.2015 to (and including) 23.03.2015.
Midterm Grades
The grades are available here.
Note that the midterm discussion will be part of the exercise sessions this week (16.4 - 20.4).
Midterm Review
You can review the midterm exam starting on the 28th of April every Tuesday and Wednesday from 2pm to 4pm until the end of the semester.
- Location: CAB H82.2
- Person of contact: Franziska Maeder
- No appointment necessary; note that time for the individual exam review may be limited in case of high level of visitation on certain date/times.