
Explore tens of thousands of sets crafted by our community.
Types of Parallelism in Computing
8
Flashcards
0/8




Task Parallelism




Consists of decomposing a task into subtasks and executing them concurrently. Example: running different algorithms on separate processors at the same time.




Instruction-level Parallelism




Aims to execute multiple instructions from a single program at the same time. Example: a CPU executing multiple assembly instructions in parallel through pipelining.




Process-level Parallelism




Involves the simultaneous execution of different processes on a system. Example: running multiple applications on different CPU cores simultaneously.




Thread-level Parallelism




Occurs when multiple threads from the same process are executed in parallel. Example: a multi-threaded application running on a multicore processor.




Vector Parallelism




Uses vector instructions to perform the same operation on large sets of data simultaneously. Example: SIMD (Single Instruction, Multiple Data) operations on a vector processor.




Hardware Parallelism




Parallelism that results from using specialized hardware, like GPU, to perform certain tasks more efficiently. Example: using a GPU to simultaneously process multiple pixels in an image.




Bit-level Parallelism




Based on increasing processor word size, allowing simultaneous processing of multiple bits. Example: a 64-bit processor working with 64 bits of data at a time, compared to a 32-bit processor.




Data Parallelism




Involves performing the same operation on different pieces of distributed data simultaneously. Example: applying a function to every element of an array across multiple processors.
© Hypatia.Tech. 2024 All rights reserved.