publications: - title: "A Spinning Join That Does Not Get Dizzy" author: - name: "Philip Werner Frey" link: "https://researchr.org/profile/philipwernerfrey/publications" - name: "Romulo Goncalves" link: "https://researchr.org/profile/romulogoncalves/publications" - name: "Martin L. Kersten" link: "http://homepages.cwi.nl/~mk/" - name: "Jens Teubner" link: "http://people.inf.ethz.ch/jteubner/" year: "2010" doi: "http://doi.ieeecomputersociety.org/10.1109/ICDCS.2010.23" abstract: "As network infrastructures with 10 Gb/s bandwidth and beyond have become pervasive and as cost advantages of large commodity-machine clusters continue to increase, research and industry strive to exploit the available processing performance for large-scale database processing tasks. In this work we look at the use of high-speed networks for distributed join processing. We propose Data Roundabout as a lightweight transport layer that uses Remote Direct Memory Access (RDMA) to gain access to the throughput opportunities in modern networks. The essence of Data Roundabout is a ring-shaped network in which each host stores one portion of a large database instance. We leverage the available bandwidth to (continuously) pump data through the high-speed network. Based on Data Roundabout, we demonstrate cyclo-join, which exploits the cycling flow of data to execute distributed joins. The study uses different join algorithms (hash join and sort-merge join) to expose the pitfalls and the advantages of each algorithm in the data cycling arena. The experiments show the potential of a large distributed main-memory cache glued together with RDMA into a novel distributed database architecture. " links: doi: "http://doi.ieeecomputersociety.org/10.1109/ICDCS.2010.23" dblp: "http://dblp.uni-trier.de/rec/bibtex/conf/icdcs/FreyGKT10" tags: - "cyclo-join" - "high-speed network" - "rule-based" - "caching" - "architecture" - "data-flow" - "database" - "distributed database" - "RDMA" researchr: "https://researchr.org/publication/FreyGKT10" cites: 25 citedby: 1 pages: "283-292" booktitle: "icdcs" kind: "inproceedings" key: "FreyGKT10" - title: "Spinning relations: high-speed networks for distributed join processing" author: - name: "Philip Werner Frey" link: "https://researchr.org/profile/philipwernerfrey/publications" - name: "Romulo Goncalves" link: "https://researchr.org/profile/romulogoncalves/publications" - name: "Martin L. Kersten" link: "http://homepages.cwi.nl/~mk/" - name: "Jens Teubner" link: "http://people.inf.ethz.ch/jteubner/" year: "2009" doi: "http://doi.acm.org/10.1145/1565694.1565701" abstract: "By leveraging modern networking hardware (RDMA-enabled network cards), we can shift priorities in distributed database processing significantly. Complex and sophisticated mechanisms to avoid network traffic can be replaced by a scheme that takes advantage of the bandwidth and low latency offered by such interconnects. We illustrate this phenomenon with cyclo-join, an efficient join algorithm based on continuously pumping data through a ring-structured network. Our approach is capable of exploiting the resources of all CPUs and distributed main-memory available in the network for processing queries of arbitrary shape and datasets of arbitrary size." links: doi: "http://doi.acm.org/10.1145/1565694.1565701" tags: - "cyclo-join" - "rule-based" - "high-speed networks" - "data-flow" - "database" - "distributed database" - "systematic-approach" - "RDMA" researchr: "https://researchr.org/publication/FreyGKT09" cites: 15 citedby: 1 pages: "27-33" booktitle: "damon" kind: "inproceedings" key: "FreyGKT09"