Skip to content

bgpdata/bgpdata

Repository files navigation




https://bgp-data.net — BGP Data Collection and Analytics Service

BGPDATA helps researchers and network operators gain insights into their networks by providing a scalable and reliable way to analyze and inspect historical and live BGP data from Route Views and RIPE NCC RIS.

Data Flow

We collect both historical and live BGP data from Route Views and RIPE NCC RIS collectors to provide comprehensive insights.

Prerequisites

Before you begin, ensure you have the following installed on your system:

Getting Started

Follow these instructions to get the project up and running on your local machine.

Clone the Repository

First, clone the repository to your local machine:

git clone [email protected]:robin-rpr/bgpdata.git
cd bgpdata

Project Structure

The project directory contains the following files:

  • Dockerfile: Dockerfile for building the application image.
  • docker-compose.yaml: Docker Compose file to set up the application and OpenBMP services.
  • requirements.txt: List of Python dependencies for the application.
  • app.py: The application code.
  • Makefile: Makefile for building and starting the services.

Build and Start the Services

To build and start BGPDATA, run the following command in the project directory:

make up

This command will:

  1. Build the Docker image for the various services.
  2. Start the services and initialize the Databases.
  3. Serve a user interface at http://localhost:8080
  4. And begin the data collection process from Route Views and RIPE NCC RIS collectors.

Accessing the Application

Once the services are up and running, you can access the user interface at http://localhost:8080. We also provide a REST API at http://localhost:8080/api/v1/ for programmatic access to the data (coming soon). As well as a Grafana dashboard at http://localhost:3000 to visualize the data and performance metrics (internal only).

ACKs

  • RIS for providing the data and collector infrastructure
  • Route Views for providing the data and collector infrastructure
  • OpenBMP for providing the invaluable OpenBMP Suite used in-depth in this project
  • Tim Evens for his leading role in the development of the OpenBMP Suite
  • RIPEstat for their incredible infrastructure and data visualization
  • RIPE Atlas for providing the RIPE Atlas infrastructure and providing mesaurement data for this project
  • Massimo Candela for his outstanding work on BGPlay
  • Christian Teuschel for his inspiration for this project and operation of RIPEstat at the RIPE NCC
  • Ben Cartwright-Cox for the development of BGP.tools and service to the Internet Community
  • CAIDA BGPStream for providing a versatile BGP data streaming library
  • Postmark for providing the email service

License

See LICENSE