 |
| Do you confius what TCS 4063 is about? |
PARALLEL COMPUTING
# The simultaneous
use of multiple compute resources to solve a computational problem:
- A problem is broken into discrete parts that can be solved concurrently
- Each part is further broken down to a series of instructions
- Instructions from each part execute simultaneously on different processors
- An overall control/coordination mechanism is employed
# The compute resources are typically:
- A single computer with multiple processors/cores
- An arbitrary number of such computers connected by a network
# The computational problem should be able to:
- Be broken apart into discrete pieces of work that can be solved simultaneously
- Execute multiple program instructions at any moment in time
- Be solved in less time with multiple compute resources than with a single compute resource.
# Virtually all stand-alone computers today are parallel from a hardware perspective:
- Multiple functional units (L1 cache, L2 cache, branch, prefetch, decode, floating-point, graphics processing (GPU), integer, etc.)
- Multiple execution units/cores
- Multiple hardware threads
# Networks connect multiple stand-alone computers (nodes) to make larger parallel computer clusters.
Source : https://computing.llnl.gov/tutorials/parallel_comp/#Whatis
Written by : Nusaibah Yahaya
Post For Week 1
No comments:
Post a Comment