next up previous
Next: Duality Between Prefetching and Up: EXTERNAL MEMORY ALGORITHMS, I/O Previous: CAMEL: Concept Annotated iMagE

   
A Framework for Index Bulk Loading and Dynamization

P. K. Agarwal, L. Arge, O. Procopiuc, and J. S. Vitter. ``A Framework for Index Bulk Loading and Dynamization,'' Proceedings of the 28th Annual International Colloquium on Automata, Languages, and Programming (ICALP '01), Crete, Greece, July 2001, published in Lecture Notes in Computer Science, 2076, Springer-Verlag, Berlin, Germany.

Full text (gzip-compressed postscript)

Full text (Adobe pdf format)

We investigate automated methods for externalizing internal memory data structures. We consider a class of balanced trees that we call weight-balanced partitioning trees (or wp-trees) for indexing a set of points in d-dimensional space. Well-known examples of wp-trees include kd-trees, BBD-trees, psuedo quad trees, and BAR trees. These trees are defined with fixed degree and are thus suited for internal memory implementations. Given an efficient wp-tree construction algorithm, we present a general framework for automatically obtaining a new dynamic external tree data structure. Using this framework together with a new general construction (bulk loading) technique of independent interest, we obtain data structures with guaranteed good update performance in terms of I/O transfers. Our approach gives considerably improved construction and update I/O bounds of kd-trees and BBD trees.


next up previous
Next: Duality Between Prefetching and Up: EXTERNAL MEMORY ALGORITHMS, I/O Previous: CAMEL: Concept Annotated iMagE
Jeff Vitter
2008-04-02