Quickstart | Documentation | Features | Roadmap | Adoption | FAQ | Town Hall

👕🌲 DataHub participates in Hacktoberfest. Refer https://hacktoberfest.digitalocean.com for more details.

• Support open source and pick a limited edition T-shirt or plant a tree.
• To earn your Hacktoberfest tee or tree reward, you must register and make 4 valid pull requests (PRs) between October 1-31 (in any time zone)
• Pull requests that we consider to be low-quality contributions, which we discourage
  • Pull requests that are automated (e.g. scripted opening pull requests to remove whitespace/fix typos/optimize images).
  • Pull requests that are disruptive (e.g. taking someone else's branch/commits and making a pull request).
  • Pull requests that are regarded by a project maintainer as a hindrance vs. helping.
  • Something that's clearly an attempt to simply +1 your pull request count for October.

📣 Next DataHub town hall meeting on November 6th, 9am-10am PDT (convert to your local time)

• Signup sheet & questions
• VC link (we're using zoom!): https://linkedin.zoom.us/j/4698262890
• Meeting details & past recordings

✨ Latest Update:

• Check out the latest DataHub Podcast @ Data Engineering Podcast.
• We've released v0.5.0-beta. You can find release notes here
• We're on Slack now! Ask questions and keep up with the latest announcements.

DataHub is LinkedIn's generalized metadata search & discovery tool. To learn more about DataHub, read our LinkedIn Engineering blog post, check out our Strata presentation and watch our Crunch Conference Talk. You should also visit DataHub Architecture to get a better understanding of how DataHub is implemented and DataHub Onboarding Guide to understand how to extend DataHub for your own use cases.

This repository contains the complete source code for both DataHub's frontend & backend. You can also read about how we sync the changes between our internal fork and GitHub.

Please follow the DataHub Quickstart Guide to get a copy of DataHub up & running locally using Docker. As the guide assumes some basic knowledge of Docker, we'd recommend you to go through the "Hello World" example of A Docker Tutorial for Beginners if Docker is completely foreign to you.

• DataHub Developer's Guide
• DataHub Architecture
• DataHub Onboarding Guide
• Docker Images
• Frontend
• Web App
• Generalized Metadata Service
• Metadata Ingestion
• Metadata Processing Jobs

See Releases page for more details. We follow the SemVer Specification when versioning the releases and adopt the Keep a Changelog convention for the changelog format.

Frequently Asked Questions about DataHub can be found here.

Check out DataHub's Features & Roadmap.

We welcome contributions from the community. Please refer to our Contributing Guidelines for more details. We also have a contrib directory for incubating experimental features.

Join our slack workspace for discussions and important announcements. You can also find out more about our upcoming town hall meetings and view past recordings.

Here are the companies that have officially adopted DataHub. Please feel free to add yours to the list if we missed it.

• Expedia Group
• Experius
• LinkedIn
• Saxo Bank
• Shanghai HuaRui Bank
• TypeForm
• Valassis

Here is a list of companies that are currently building POC or seriously evaluating DataHub.

• Amadeus
• Booking.com
• Experian
• FlixBus
• Geotab
• Kindred Group
• Instructure
• Inventec
• Microsoft
• Morgan Stanley
• Orange Telecom
• REEF Technology
• SpotHero
• Sysco AS
• ThoughtWorks
• University of Phoenix
• Vectice
• Viasat
• Wolt
• Weee!

• DataHub: A Generalized Metadata Search & Discovery Tool
• Open sourcing DataHub: LinkedIn’s metadata search and discovery platform
• DataHub: Powering LinkedIn's Metadata @ Budapest Data Forum 2020
• Metadata Management And Integration At LinkedIn With DataHub @ Data Engineering Podcast
• The evolution of metadata: LinkedIn’s story @ Strata Data Conference 2019
• Journey of metadata at LinkedIn @ Crunch Data Conference 2019
• DataHub Journey with Expedia Group
• Saxo Bank's Data Workbench
• Data Discoverability at SpotHero
• Data Catalogue — Knowing your data
• LinkedIn DataHub Application Architecture Quick Understanding
• LinkIn Datahub Metadata Ingestion Scripts Unofficical Guide
• A Dive Into Metadata Hubs
• 25 Hot New Data Tools and What They DON’T Do

See the full list here.