Skip to content

G-Research/datahub

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DataHub: A Generalized Metadata Search & Discovery Tool

Version build & test Get on Slack PRs Welcome License


Quickstart | Documentation | Features | Roadmap | Adoption | FAQ | Town Hall


DataHub

📣 Next DataHub town hall meeting on August 28th, 9am-10am PDT (convert to your local time)

✨ Latest Update:

  • We've released v0.4.2. You can find release notes here
  • We're on Slack now! Ask questions and keep up with the latest announcements.

Introduction

DataHub is LinkedIn's generalized metadata search & discovery tool. To learn more about DataHub, check out our LinkedIn Engineering blog post and Strata presentation. You should also visit DataHub Architecture to get a better understanding of how DataHub is implemented and DataHub Onboarding Guide to understand how to extend DataHub for your own use cases.

This repository contains the complete source code for both DataHub's frontend & backend. You can also read about how we sync the changes between our internal fork and GitHub.

Quickstart

Please follow the DataHub Quickstart Guide to get a copy of DataHub up & running locally using Docker. As the guide assumes some basic knowledge of Docker, we'd recommend you to go through the "Hello World" example of A Docker Tutorial for Beginners if Docker is completely foreign to you.

Documentation

Releases

See Releases page for more details. We follow the SemVer Specification when versioning the releases and adopt the Keep a Changelog convention for the changelog format.

FAQs

Frequently Asked Questions about DataHub can be found here.

Features & Roadmap

Check out DataHub's Features & Roadmap.

Contributing

We welcome contributions from the community. Please refer to our Contributing Guidelines for more details. We also have a contrib directory for incubating experimental features.

Community

Join our slack workspace for discussions and important announcements. You can also find out more about our upcoming town hall meetings and view past recordings.

Adoption

Here are the companies that have officially adopted DataHub. Please feel free to add yours to the list if we missed it.

Here is a list of companies that are currently building POC or seriously evaluating DataHub.

Select Articles & Talks

See the full list here.

About

A Metadata Platform for the Modern Data Stack

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 45.5%
  • Python 34.5%
  • TypeScript 16.7%
  • JavaScript 1.8%
  • SCSS 0.6%
  • Shell 0.3%
  • Other 0.6%