Speedup
From Wikipedia, the free encyclopedia
In parallel computing, speedup refers to how much a parallel algorithm is faster than a corresponding sequential algorithm.
It is defined by the following formula:
where:
- p is the number of processors
- T1 is the execution time of the sequential algorithm
- Tp is the execution time of the parallel algorithm with p processors
Linear speedup or ideal speedup is obtained when 
. When running an algorithm with linear speedup, doubling the number of processors doubles the speed which, as it is ideal, is considered very good scalability.
Efficiency is a performance metric defined as 
. It is a value, typically between zero and one, estimating how well-utilized the processors are in solving the problem, compared to how much effort is wasted in communication and synchronization. Algorithms with linear speedup and algorithms running on a single processor have an efficiency of 1, while many difficult-to-parallelize algorithms have efficiency such as 
that approaches zero as the number of processors increases.
Super linear speedup: Sometimes a speedup of more than N when using N processors is observed in parallel computing, which is called super linear speedup. Super linear speedup rarely happens and often confuses beginners, who believe the theoretical maximum speedup should be N when N processors are used. However, it is understandable due to the cache effect resulting from the different memory hierarchies of a modern computer: In parallel computing, not only the numbers of processors change, so does the size of accumulated caches from different processors. With the larger accumulated cache size, more or even all core data set can fit into caches and the memory access time reduces dramatically, with causes the extra speedup in additional to those come from computation.
