Parallel Computing for Beginners

By: Joel C. Adams, Richard A. Brown, Suzanne J. Matthews, and Elizabeth Shoop (CSinParallel) and Contributing Authors: Dorian Arnold, Steven Bogaerts, and John Rieffel

NOTE: THIS BOOK IS STILL A WORK IN PROGRESS!

Table of Contents

• About Parallel Computing for Beginners
  • How to use this book
  • Contributing
• CHAPTER 0: Introduction
  • 0.0 Computing
  • 0.1 Computing Hardware
  • 0.2 Parallel Computing
  • 0.3 Parallel Performance
  • 0.4 Parallel Programming Strategies
  • 0.5 Parallel Computing Hardware Platforms
• CHAPTER 1: Shared Memory
  • 1.0 Shared Memory Preliminaries
  • 1.1 First Steps - Programming Shared Memory
  • 1.2 Race Conditions
  • 1.3 Reduction
  • 1.4 Real World Problem - Drug Design
• CHAPTER 2: Message Passing
  • 2.1 First Steps - Programming with Message Passing
  • 2.2 Point to Point Communication
  • 2.3 Deadlock
  • 2.4 Other Communication Patterns
  • 2.5 Real World Example - Forest Fire Simulation
• CHAPTER 3: Common Algorithmic Patterns
  • 3.1 Parallel Selection
  • 3.2 Shared Queue
• CHAPTER 4: GPU Computing Basics with CUDA C
  • 4.1 The manycore GPU device in a host
  • 4.2 GPU Programming model
  • 4.3 Mapping Threads to Data Elements
  • 4.4 Example: Vector Addition
  • 4.5 Vector Addition example with CUDA Unified Memory
  • 4.6 Vector Addition Example with Timing
• CHAPTER 5: Applications
  • 5.1 AI Applications - Minimax Algorithm
  • 5.2 Matrix Multiplication
• CHAPTER 6: Further Avenues of Exploration
  • 4.1 MapReduce
  • 4.4 Other Free Resources For Learning Parallel Computing

To Cite:

Adams J.C., Brown R., Matthews S.J., Shoop E., and others. PDC for Beginners, 0.1 Edition. Available online: https://dx.doi.org/10.55682/VXWY1300

Acknowledgements

This work is sponsored by National Science Foundation (NSF) Collaborative Research Grants DUE-1822480/1822486/1855761. Collaborative Research: CSinParallel: Experiential Learning of Parallel and Distributed Computing through Sight, Sound, and Touch

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

You have attempted of activities on this page