WebGraph: The Next Generation (Is in Rust) - Equipe Autonomic and Critical Embedded Systems
Conference Papers Year : 2024

WebGraph: The Next Generation (Is in Rust)

Abstract

We report the results of a yearlong effort to port the WebGraph framework from Java to Rust. For two decades WebGraph has been instrumental in the analysis and distribution of large graphs for the research community of TheWebConf, but the intrinsic limitations of the Java Virtual Machine had become a bottleneck for very large use cases, such as the Software Heritage Merkle graph with its half a trillion arcs. As part of this clean-slate implementation of WebGraph in Rust, we developed a few ancillary projects bringing to the Rust ecosystem some missing features of independent interest, such as easy, consistent and zero-cost memory mapping of data structures. WebGraph in Rust offers impressive performance improvements over the previous implementation, enabling open-source graph analytics on very large datasets on top of a modern system programming language.
Fichier principal
Vignette du fichier
main.pdf (434.61 Ko) Télécharger le fichier
Origin Publication funded by an institution

Dates and versions

hal-04494627 , version 1 (07-03-2024)

Identifiers

Cite

Tommaso Fontana, Sebastiano Vigna, Stefano Zacchiroli. WebGraph: The Next Generation (Is in Rust). ACM Web Conference 2024, May 2024, Singapore, Singapore. ⟨10.1145/3589335.3651581⟩. ⟨hal-04494627⟩
834 View
243 Download

Altmetric

Share

More