Prepared by:
Kristine Marie Simeon
Objectives
Objectives
•What is Parallel
Organization
•Common Multiple
processor organization
Types of Parallel Processor System
Parallel
Organization
·
Multiple
processing units cooperate to execute applications.
·
parallel
processing makes programs run
faster because there are more engines (CPUs or cores) running it.
faster because there are more engines (CPUs or cores) running it.
2 most common Multiple Processor Organization
•Symmetric
multiprocessor - consist of multiple processor within the same
computer, interconnected with a bus or some sort of switching arrangement
•Cluster- group of interconnected, whole
computers working together
Types of Parallel Processing System
•Single instruction, single data stream
–SISD
•Single instruction, multiple
data stream – SIMD
•Multiple instruction, single
data stream – MISD
•Multiple instruction, multiple
data stream- MIMD
Single Instruction, Single Data Stream – SISD
•Single processor
•Single instruction stream
Single Instruction, Multiple Data Stream
– SIMD
•Single machine
instruction
– Each instruction executed on different set of data by different processors–
•Number of processing elements– Machine controls simultaneous execution
• Lockstep basis– Each processing element has associated data memory
– Each instruction executed on different set of data by different processors–
•Number of processing elements– Machine controls simultaneous execution
• Lockstep basis– Each processing element has associated data memory
Multiple Instruction, Single Data Stream
– MISD
•Sequence of data
•Transmitted to set of processors
•Each processor executes different
instruction sequence
Multiple
Instruction, Multiple Data Stream- MIMD
•Set of processors
•Simultaneously
executes different instruction sequences
•Different sets of
data
•Examples: SMPs,
NUMA
systems, and
Clusters
References:
•http://www.authorstream.com/Presentation/snehaendait-314446-parallel-organization-processing-sisd-simd-misd-mimd-education-ppt-powerpoint/
__________________________________________________________