A System for Fast, Accurate, and Intuitive Querying of Large-Scale BGP Datasets
Thomas Holterbach , Thomas Alfroy , Abbas Mohsenpour , Thomas Krenc , K. C. Claffy and Cristel Pelsser
This 2026 international conference paper, by Thomas Holterbach and 5 coauthors, was presented at Proceedings of the 2026 ACM Internet Measurement Conference (IMC '26). Topics covered include internet measurement, bgp, and routing security.
Full author list: Thomas Holterbach, Thomas Alfroy, Abbas Mohsenpour, Thomas Krenc, K. C. Claffy, and Cristel Pelsser.
Abstract
BGP data collected from operational routers by platforms such as RIPE RIS or RouteViews is essential to address connectivity issues and analyze the global Internet's structure. However, the vast and ever-growing volume of this data makes deriving useful insights challenging: Existing APIs and dashboards offer limited perspectives, while analyzing large archives of MRT files is slow and cumbersome. We present ChatBGP, a domain-specific chatbot that turns plain-English questions about BGP data into Python code that runs swiftly and returns accurate answers. ChatBGP is enabled by four contributions: (i) a measurement study showing that BGP data is highly redundant and therefore highly compressible; (ii) a database scheme that exploits this redundancy to compress BGP data while enabling fast retrieval of specific data elements; (iii) an expressive API that exposes this database through a simple interface; and (iv) a prompt-engineering scheme that guides ChatGPT to synthesize optimized Python code that uses this API to accurately answer user queries, while retrieving only the data needed to answer each query. With ChatBGP, gaining insights into BGP data becomes effortless and significantly faster—e.g., delivering results in seconds instead of hours with existing tools. Network operators can rapidly diagnose connectivity issues, including security threats, researchers can analyze larger datasets while improving reproducibility, and students can engage with BGP monitoring in a more intuitive and interactive way.
Publication Details
- Publication Type
- Conference Paper
- Publication Date
- October 2026
- Published In
- Proceedings of the 2026 ACM Internet Measurement Conference (IMC '26)
- Pages
- 1082–1101
- Publisher
- Association for Computing Machinery
- Location
- Karlsruhe, Germany
- Digital Object Identifier (DOI)
- 10.1145/3777912.3839829
- External Link
- https://doi.org/10.1145/3777912.3839829
Suggested citation
Thomas Holterbach, Thomas Alfroy, Abbas Mohsenpour, Thomas Krenc, K. C. Claffy, and Cristel Pelsser. 2026. A System for Fast, Accurate, and Intuitive Querying of Large-Scale BGP Datasets. In Proceedings of the 2026 ACM Internet Measurement Conference (IMC '26). Association for Computing Machinery, Karlsruhe, Germany, 1082–1101. https://doi.org/10.1145/3777912.3839829
BibTeX Citation
BibTeX Citation
@inproceedings{Holterbach2026,
title = {A System for Fast, Accurate, and Intuitive Querying of Large-Scale {BGP} Datasets},
author = {Thomas Holterbach and Thomas Alfroy and Abbas Mohsenpour and Thomas Krenc and K. C. Claffy and Cristel Pelsser},
year = 2026,
month = oct,
day = 12,
booktitle = {Proceedings of the 2026 ACM Internet Measurement Conference ({IMC} '26)},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
location = {Karlsruhe, Germany},
pages = {1082--1101},
numpages = 20,
doi = {10.1145/3777912.3839829},
isbn = {979-8-4007-2327-8},
url = {https://doi.org/10.1145/3777912.3839829},
abstract = {BGP data collected from operational routers by platforms such as RIPE RIS or RouteViews is essential to address connectivity issues and analyze the global Internet's structure. However, the vast and ever-growing volume of this data makes deriving useful insights challenging: Existing APIs and dashboards offer limited perspectives, while analyzing large archives of MRT files is slow and cumbersome. We present ChatBGP, a domain-specific chatbot that turns plain-English questions about BGP data into Python code that runs swiftly and returns accurate answers. ChatBGP is enabled by four contributions: (i) a measurement study showing that BGP data is highly redundant and therefore highly compressible; (ii) a database scheme that exploits this redundancy to compress BGP data while enabling fast retrieval of specific data elements; (iii) an expressive API that exposes this database through a simple interface; and (iv) a prompt-engineering scheme that guides ChatGPT to synthesize optimized Python code that uses this API to accurately answer user queries, while retrieving only the data needed to answer each query. With ChatBGP, gaining insights into BGP data becomes effortless and significantly faster—e.g., delivering results in seconds instead of hours with existing tools. Network operators can rapidly diagnose connectivity issues, including security threats, researchers can analyze larger datasets while improving reproducibility, and students can engage with BGP monitoring in a more intuitive and interactive way.},
groups = {International Conferences},
keywords = {Internet measurement, BGP, Routing Security}
}
Related publications
Internet Science Moonshot: Expanding BGP Data Horizons
Thomas Alfroy, Thomas Holterbach, and Thomas Krenc, et al.
Proceedings of the 22nd ACM Workshop on Hot Topics in Networks HotNets, 2023
The Next Generation of BGP Data Collection Platforms
Thomas Alfroy, Thomas Holterbach, and Thomas Krenc, et al.
Proceedings of the ACM SIGCOMM 2024 Conference, 2024
The BGP Visibility Toolkit: Detecting Anomalous Internet Routing Behavior
Andra Lutu, Marcelo Bagnulo, and Cristel Pelsser, et al.
IEEE/ACM Transactions on Networking, 2015
Enforcing RPKI-based routing policy on the data plane at an internet exchange
Josh Bailey, Dean Pemberton, and Andy Linton, et al.
Proceedings of the third workshop on Hot topics in software defined networking, HotSDN '14, 2014