Sandbox prefetching: safe run-time evaluation of aggressive prefetchers

Update item information
Publication Type pre-print
School or College College of Engineering
Department Computing, School of
Creator Balasubramonian, Rajeev
Other Author Pugsley, Seth H.; Chishti, Zeshan; Wilkerson, Chis; Chuang, Peng-fei; Scott, Robert L.; Jaleel, Aamer; Lu, Shih-Lien; Chow, Kingsum
Title Sandbox prefetching: safe run-time evaluation of aggressive prefetchers
Date 2014-01-01
Description Memory latency is a major factor in limiting CPU per- formance, and prefetching is a well-known method for hiding memory latency. Overly aggressive prefetching can waste scarce resources such as memory bandwidth and cache capacity, limiting or even hurting performance. It is therefore important to employ prefetching mechanisms that use these resources prudently, while still prefetching required data in a timely manner. In this work, we propose a new mechanism to deter-mine at run-time the appropriate prefetching mechanism for the currently executing program, called Sandbox Prefetching. Sandbox Prefetching evaluates simple, aggressive offset prefetchers at run-time by adding the prefetch address to a Bloom filter, rather than actually fetching the data into the cache. Subsequent cache accesses are tested against the contents of the Bloom filter to see if the aggressive prefetcher under evaluation could have accurately prefetched the data, while simultaneously testing for the existence of prefetchable streams. Real prefetches are performed when the accuracy of evaluated prefetchers exceeds a threshold. This method combines the ideas of global pattern confirmation and immediate prefetching action to achieve high performance. Sandbox Prefetching improves performance across the tested workloads by 47.6% compared to not using any prefetching, and by 18.7% compared to the Feedback Directed Prefetching technique. Performance is also improved by 1.4% compared to the Access Map Pattern Matching Prefetcher, while incurring consid- erably less logic and storage overheads.
Type Text
Publisher Institute of Electrical and Electronics Engineers (IEEE)
First Page 1
Last Page 12
Language eng
Bibliographic Citation Pugsley, Seth H., Chishti, Zeshan, Wilkerson, Chris, Chuang, Peng-fei, Scott, Robert L., Jaleel, Aamer, Lu, Shih-Lien, Chow, Kingsum, & Balasubramonian, Rajeev. (2014). Sandbox prefetching: safe run-time evaluation of aggressive prefetchers. Proceedings - International Symposium on High-Performance Computer Architecture, 1-12.
Rights Management (c) 2014 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Format Medium application/pdf
Format Extent 623,525 bytes
Identifier uspace,18834
ARK ark:/87278/s6c56vxc
Setname ir_uspace
Date Created 2014-08-12
Date Modified 2021-05-06
ID 712631
Reference URL https://collections.lib.utah.edu/ark:/87278/s6c56vxc
Back to Search Results