next up previous
Next: Practical Prefetching via Data Up: LEARNING, PREDICTION, ESTIMATION, CACHING, Previous: Learning in Parallel

   
Optimal Prefetching via Data Compression

J. S. Vitter and P. Krishnan. ``Optimal Prefetching via Data Compression,'' Journal of the ACM, 43(5) September 1996, 771-793. A shortened version appears in Proceedings of the 32nd Annual IEEE Symposium on Foundations of Computer Science (FOCS '91), San Juan, Puerto Rico, October 1991, 121-130.

Full text (Adobe pdf format)

Caching and prefetching are important mechanisms for speeding up access time to data on secondary storage. Recent work in competitive online algorithms has uncovered several promising new algorithms for caching. In this paper, we apply a form of the competitive philosophy for the first time to the problem of prefetching to develop an optimal universal prefetcher in terms of fault ratio, with particular applications to large-scale databases and hypertext systems. Our algorithms for prefetching are novel in that they are based on data compression techniques that are both theoretically optimal and good in practice. Intuitively, in order to compress data effectively, you have to be able to predict future data well, and thus good data compressors should be able to predict well for purposes of prefetching. We show for powerful models such as Markov sources and mth order Markov sources that the page fault rates incurred by our prefetching algorithms are optimal in the limit for almost all sequences of page accesses.


next up previous
Next: Practical Prefetching via Data Up: LEARNING, PREDICTION, ESTIMATION, CACHING, Previous: Learning in Parallel
Jeff Vitter
2008-04-02