Storage Sub-System Flashcards
What is the formula for Average Memory Access Time (AMAT)
AMAT = Hit time + (Miss rate × Miss penalty)
What are the three components of cache performance
- Hit time
- Miss rate
- Miss penalty
Define hit time in cache performance
The time taken to access data from the cache successfully
What is a miss penalty
the additional time required to fetch data from a lower-level cache or main memory after a cache miss
Define cache miss
a state where data requested by a component (such as a processor) is not found in the cache
What are the three main categories of cache performance optimisation
- reducing miss rate
- reducing miss penalty
- reducing hit time
How can we reduce the miss rate in a cache
increase block size, increase cache size and use higher associativity
what is associativity
How can we reduce the miss penalty
use multilevel caches and prioritise read operations over writes
why prioritise multilevel caches
✅ Multilevel caches improve speed by catching data closer to the CPU.
✅ They reduce memory access time by lowering miss penalties.
✅ They balance speed vs. size, keeping small caches fast and large caches efficient.
✅ They save power, reducing RAM access.
✅ They enhance multi-core performance, enabling efficient data sharing.
How can hit time be reduced
optimise cache structure and use faster technologies
how can we optimise cache structure
What are the three types of cache misses
- compulsory miss
- capacity miss
- conflict miss
What is a compulsory miss
a miss that occurs when data is accessed for the first time and must be loaded into the cache (it currently isn’t there)
What is a capacity miss
A miss that happens when the cache is too small to store all required data, causing frequent discarded data
what is a conflict miss
A miss due to limited associativity, where multiple blocks compete for the same cache location even though there is space else where in the cache
Explain the differences between a capacity and conflict miss
explain conflict miss
How does adding a second level cache improve performance
It reduces the miss penalty by catching accesses that would otherwise go to main memory
What is the formula for AMAT in a two level cache system
AMAT = Hit timeL1 + Miss rateL1 × (Hit timeL2 + Miss rateL2 × Miss penaltyL2)
What is the difference between local and a global miss rates
Local miss rate: Misses in a cache divided by total accesses to that cache.
Global miss rate: Misses in a cache divided by total accesses from the processor.
How does higher associativity affect cache performance
It reduces conflict misses but may increase hit time.
What happens off the block size is too large relative to the case size
Miss rate may increase due to more conflict and capacity misses.
What is the trade off when increasing block size
It reduces compulsory misses but may increase miss penalty and conflict misses.
What is associatively in case memory
Associativity determines how memory blocks are mapped from main memory into cache.