Skip to content

Commit

Permalink
docs: points to docker images hosted by linkedin org (datahub-project…
Browse files Browse the repository at this point in the history 
…#1683)

As we're now utilize GitHub Actions to build & publish docker images to docker hub under linkedin org
Also allow overriding image tags via DATAHUB_VERSION environment variable
  • Loading branch information
@mars-lan
mars-lan committed Jun 25, 2020
1 parent cee2d69 commit ea2377d
Show file tree
Hide file tree
Showing 26 changed files with 49 additions and 49 deletions.
8 changes: 4 additions & 4 deletions contrib/kubernetes/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -41,16 +41,16 @@ The following table lists the configuration parameters and its default values
| Key | Type | Default | Description |
|-----|------|---------|-------------|
| datahub-frontend.enabled | bool | `true` | |
| datahub-frontend.image.repository | string | `"keremsahin/datahub-frontend"` | |
| datahub-frontend.image.repository | string | `"linkedin/datahub-frontend"` | |
| datahub-frontend.image.tag | string | `"latest"` | |
| datahub-gms.enabled | bool | `true` | |
| datahub-gms.image.repository | string | `"keremsahin/datahub-gms"` | |
| datahub-gms.image.repository | string | `"linkedin/datahub-gms"` | |
| datahub-gms.image.tag | string | `"latest"` | |
| datahub-mae-consumer.enabled | bool | `true` | |
| datahub-mae-consumer.image.repository | string | `"keremsahin/datahub-mae-consumer"` | |
| datahub-mae-consumer.image.repository | string | `"linkedin/datahub-mae-consumer"` | |
| datahub-mae-consumer.image.tag | string | `"latest"` | |
| datahub-mce-consumer.enabled | bool | `true` | |
| datahub-mce-consumer.image.repository | string | `"keremsahin/datahub-mce-consumer"` | |
| datahub-mce-consumer.image.repository | string | `"linkedin/datahub-mce-consumer"` | |
| datahub-mce-consumer.image.tag | string | `"latest"` | |
| global.datahub.appVersion | string | `"1.0"` | |
| global.datahub.gms.host | string | `"datahub-gms-deployment"` | |
Expand Down
8 changes: 4 additions & 4 deletions contrib/kubernetes/datahub/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -18,16 +18,16 @@ Current chart version is `0.0.1`
| Key | Type | Default | Description |
|-----|------|---------|-------------|
| datahub-frontend.enabled | bool | `true` | |
| datahub-frontend.image.repository | string | `"keremsahin/datahub-frontend"` | |
| datahub-frontend.image.repository | string | `"linkedin/datahub-frontend"` | |
| datahub-frontend.image.tag | string | `"latest"` | |
| datahub-gms.enabled | bool | `true` | |
| datahub-gms.image.repository | string | `"keremsahin/datahub-gms"` | |
| datahub-gms.image.repository | string | `"linkedin/datahub-gms"` | |
| datahub-gms.image.tag | string | `"latest"` | |
| datahub-mae-consumer.enabled | bool | `true` | |
| datahub-mae-consumer.image.repository | string | `"keremsahin/datahub-mae-consumer"` | |
| datahub-mae-consumer.image.repository | string | `"linkedin/datahub-mae-consumer"` | |
| datahub-mae-consumer.image.tag | string | `"latest"` | |
| datahub-mce-consumer.enabled | bool | `true` | |
| datahub-mce-consumer.image.repository | string | `"keremsahin/datahub-mce-consumer"` | |
| datahub-mce-consumer.image.repository | string | `"linkedin/datahub-mce-consumer"` | |
| datahub-mce-consumer.image.tag | string | `"latest"` | |
| global.datahub.appVersion | string | `"1.0"` | |
| global.datahub.gms.host | string | `"datahub-gms-deployment"` | |
Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/datahub/charts/datahub-frontend/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ Current chart version is `0.1.0`
| global.datahub.gms.port | string | `"8080"` | |
| global.datahub.gms.secret | string | `"YouKnowNothing"` | |
| image.pullPolicy | string | `"IfNotPresent"` | |
| image.repository | string | `"keremsahin/datahub-frontend"` | |
| image.repository | string | `"linkedin/datahub-frontend"` | |
| image.tag | string | `"latest"` | |
| imagePullSecrets | list | `[]` | |
| ingress.annotations | object | `{}` | |
Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/datahub/charts/datahub-frontend/values.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
replicaCount: 1

image:
repository: keremsahin/datahub-frontend
repository: linkedin/datahub-frontend
tag: "latest"
pullPolicy: IfNotPresent

Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/datahub/charts/datahub-gms/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ Current chart version is `0.1.0`
| global.sql.datasource.url | string | `"jdbc:mysql://192.168.0.104:3306/datahub?verifyServerCertificate=false\u0026useSSL=true"` | |
| global.sql.datasource.username | string | `"datahub"` | |
| image.pullPolicy | string | `"IfNotPresent"` | |
| image.repository | string | `"keremsahin/datahub-gms"` | |
| image.repository | string | `"linkedin/datahub-gms"` | |
| image.tag | string | `"latest"` | |
| imagePullSecrets | list | `[]` | |
| ingress.annotations | object | `{}` | |
Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/datahub/charts/datahub-gms/values.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
replicaCount: 1

image:
repository: keremsahin/datahub-gms
repository: linkedin/datahub-gms
pullPolicy: IfNotPresent
tag: latest

Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/datahub/charts/datahub-mae-consumer/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ Current chart version is `0.1.0`
| global.hostAliases[0].hostnames[3] | string | `"neo4j"` | |
| global.hostAliases[0].ip | string | `"192.168.0.104"` | |
| image.pullPolicy | string | `"IfNotPresent"` | |
| image.repository | string | `"keremsahin/datahub-mae-consumer"` | |
| image.repository | string | `"linkedin/datahub-mae-consumer"` | |
| image.tag | string | `"latest"` | |
| imagePullSecrets | list | `[]` | |
| ingress.annotations | object | `{}` | |
Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/datahub/charts/datahub-mae-consumer/values.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
replicaCount: 1

image:
repository: keremsahin/datahub-mae-consumer
repository: linkedin/datahub-mae-consumer
pullPolicy: IfNotPresent
tag: latest

Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/datahub/charts/datahub-mce-consumer/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ Current chart version is `0.1.0`
| global.hostAliases[0].hostnames[3] | string | `"neo4j"` | |
| global.hostAliases[0].ip | string | `"192.168.0.104"` | |
| image.pullPolicy | string | `"IfNotPresent"` | |
| image.repository | string | `"keremsahin/datahub-mce-consumer"` | |
| image.repository | string | `"linkedin/datahub-mce-consumer"` | |
| image.tag | string | `"latest"` | |
| imagePullSecrets | list | `[]` | |
| ingress.annotations | object | `{}` | |
Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/datahub/charts/datahub-mce-consumer/values.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
replicaCount: 1

image:
repository: keremsahin/datahub-mce-consumer
repository: linkedin/datahub-mce-consumer
pullPolicy: IfNotPresent
tag: latest

Expand Down
8 changes: 4 additions & 4 deletions contrib/kubernetes/datahub/values.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,25 +5,25 @@
datahub-gms:
enabled: true
image:
repository: keremsahin/datahub-gms
repository: linkedin/datahub-gms
tag: "latest"

datahub-frontend:
enabled: true
image:
repository: keremsahin/datahub-frontend
repository: linkedin/datahub-frontend
tag: "latest"

datahub-mae-consumer:
enabled: true
image:
repository: keremsahin/datahub-mae-consumer
repository: linkedin/datahub-mae-consumer
tag: "latest"

datahub-mce-consumer:
enabled: true
image:
repository: keremsahin/datahub-mce-consumer
repository: linkedin/datahub-mce-consumer
tag: "latest"

global:
Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/yaml/datahub-frontend-deployment.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ spec:
spec:
containers:
- name: datahub-frontend
image: keremsahin/datahub-frontend:latest
image: linkedin/datahub-frontend:latest
ports:
- containerPort: 9001
env:
Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/yaml/datahub-gms-deployment.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ spec:
spec:
containers:
- name: datahub-gms
image: keremsahin/datahub-gms:latest
image: linkedin/datahub-gms:latest
ports:
- containerPort: 8080
command: ["/bin/sh", "-c" ,"java -jar jetty-runner-9.4.20.v20190813.jar gms.war"]
Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/yaml/datahub-mae-consumer-deployment.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ spec:
spec:
containers:
- name: datahub-mae-consumer
image: keremsahin/datahub-mae-consumer:latest
image: linkedin/datahub-mae-consumer:latest
command: ["/bin/sh", "-c" ,"./mae-consumer-job/bin/mae-consumer-job"]
env:
- name: KAFKA_BOOTSTRAP_SERVER
Expand Down
2 changes: 1 addition & 1 deletion contrib/kubernetes/yaml/datahub-mce-consumer-deployment.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ spec:
spec:
containers:
- name: datahub-mce-consumer
image: keremsahin/datahub-mce-consumer:latest
image: linkedin/datahub-mce-consumer:latest
command: ["/bin/sh", "-c" ,"./mce-consumer-job/bin/mce-consumer-job"]
env:
- name: KAFKA_BOOTSTRAP_SERVER
Expand Down
10 changes: 5 additions & 5 deletions docker/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
# Docker Images
The easiest way to bring up and test DataHub is using DataHub [Docker](https://www.docker.com) images
which are continuously deployed to [Docker Hub](https://hub.docker.com/u/keremsahin) with every commit to repository.
which are continuously deployed to [Docker Hub](https://hub.docker.com/u/linkedin) with every commit to repository.

* [**datahub-gms**](gms): [![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-gms)](https://cloud.docker.com/repository/docker/keremsahin/datahub-gms/)
* [**datahub-frontend**](frontend): [![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-frontend)](https://cloud.docker.com/repository/docker/keremsahin/datahub-frontend/)
* [**datahub-mce-consumer**](mce-consumer): [![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-mce-consumer)](https://cloud.docker.com/repository/docker/keremsahin/datahub-mce-consumer/)
* [**datahub-mae-consumer**](mae-consumer): [![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-mae-consumer)](https://cloud.docker.com/repository/docker/keremsahin/datahub-mae-consumer/)
* [linkedin/datahub-gms](https://cloud.docker.com/repository/docker/linkedin/datahub-gms/)
* [linkedin/datahub-frontend](https://cloud.docker.com/repository/docker/linkedin/datahub-frontend/)
* [linkedin/datahub-mae-consumer](https://cloud.docker.com/repository/docker/linkedin/datahub-mae-consumer/)
* [linkedin/datahub-mce-consumer](https://cloud.docker.com/repository/docker/linkedin/datahub-mce-consumer/)

Above Docker images are created for DataHub specific use. You can check subdirectories to check how those images are
generated via [Dockerbuild](https://docs.docker.com/engine/reference/commandline/build/) files or
Expand Down
4 changes: 2 additions & 2 deletions docker/frontend/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
# DataHub Frontend Docker Image
[![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-frontend)](https://cloud.docker.com/repository/docker/keremsahin/datahub-frontend/)
[![datahub-frontend docker](https://github.com/linkedin/datahub/workflows/datahub-frontend%20docker/badge.svg)](https://github.com/linkedin/datahub/actions?query=workflow%3A%22datahub-frontend+docker%22)

Refer to [DataHub Frontend Service](../../datahub-frontend) to have a quick understanding of the architecture and
responsibility of this service for the DataHub.

## Build
```
docker image build -t keremsahin/datahub-frontend -f docker/frontend/Dockerfile .
docker image build -t linkedin/datahub-frontend -f docker/frontend/Dockerfile .
```
This command will build and deploy the image in your local store.

Expand Down
2 changes: 1 addition & 1 deletion docker/frontend/docker-compose.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
version: '3.5'
services:
datahub-frontend:
image: keremsahin/datahub-frontend:latest
image: linkedin/datahub-frontend:${DATAHUB_VERSION:-latest}
hostname: datahub-frontend
container_name: datahub-frontend
ports:
Expand Down
4 changes: 2 additions & 2 deletions docker/gms/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
# DataHub Generalized Metadata Store (GMS) Docker Image
[![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-gms)](https://cloud.docker.com/repository/docker/keremsahin/datahub-gms/)
[![datahub-gms docker](https://github.com/linkedin/datahub/workflows/datahub-gms%20docker/badge.svg)](https://github.com/linkedin/datahub/actions?query=workflow%3A%22datahub-gms+docker%22)

Refer to [DataHub GMS Service](../../gms) to have a quick understanding of the architecture and
responsibility of this service for the DataHub.

## Build
```
docker image build -t keremsahin/datahub-gms -f docker/gms/Dockerfile .
docker image build -t linkedin/datahub-gms -f docker/gms/Dockerfile .
```
This command will build and deploy the image in your local store.

Expand Down
2 changes: 1 addition & 1 deletion docker/gms/docker-compose.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
version: '3.5'
services:
datahub-gms:
image: keremsahin/datahub-gms:latest
image: linkedin/datahub-gms:${DATAHUB_VERSION:-latest}
hostname: datahub-gms
container_name: datahub-gms
ports:
Expand Down
4 changes: 2 additions & 2 deletions docker/mae-consumer/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
# DataHub MetadataAuditEvent (MAE) Consumer Docker Image
[![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-mae-consumer)](https://cloud.docker.com/repository/docker/keremsahin/datahub-mae-consumer/)
[![datahub-mae-consumer docker](https://github.com/linkedin/datahub/workflows/datahub-mae-consumer%20docker/badge.svg)](https://github.com/linkedin/datahub/actions?query=workflow%3A%22datahub-mae-consumer+docker%22)

Refer to [DataHub MAE Consumer Job](../../metadata-jobs/mae-consumer-job) to have a quick understanding of the architecture and
responsibility of this service for the DataHub.

## Build
```
docker image build -t keremsahin/datahub-mae-consumer -f docker/mae-consumer/Dockerfile .
docker image build -t linkedin/datahub-mae-consumer -f docker/mae-consumer/Dockerfile .
```
This command will build and deploy the image in your local store.

Expand Down
2 changes: 1 addition & 1 deletion docker/mae-consumer/docker-compose.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
version: '3.5'
services:
datahub-mae-consumer:
image: keremsahin/datahub-mae-consumer:latest
image: linkedin/datahub-mae-consumer:${DATAHUB_VERSION:-latest}
hostname: datahub-mae-consumer
container_name: datahub-mae-consumer
ports:
Expand Down
4 changes: 2 additions & 2 deletions docker/mce-consumer/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
# DataHub MetadataChangeEvent (MCE) Consumer Docker Image
[![Docker Cloud Build Status](https://img.shields.io/docker/cloud/build/keremsahin/datahub-mce-consumer)](https://cloud.docker.com/repository/docker/keremsahin/datahub-mce-consumer/)
[![datahub-mce-consumer docker](https://github.com/linkedin/datahub/workflows/datahub-mce-consumer%20docker/badge.svg)](https://github.com/linkedin/datahub/actions?query=workflow%3A%22datahub-mce-consumer+docker%22)

Refer to [DataHub MCE Consumer Job](../../metadata-jobs/mce-consumer-job) to have a quick understanding of the architecture and
responsibility of this service for the DataHub.

## Build
```
docker image build -t keremsahin/datahub-mce-consumer -f docker/mce-consumer/Dockerfile .
docker image build -t linkedin/datahub-mce-consumer -f docker/mce-consumer/Dockerfile .
```
This command will build and deploy the image in your local store.

Expand Down
2 changes: 1 addition & 1 deletion docker/mce-consumer/docker-compose.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
version: '3.5'
services:
datahub-mce-consumer:
image: keremsahin/datahub-mce-consumer:latest
image: linkedin/datahub-mce-consumer:${DATAHUB_VERSION:-latest}
hostname: datahub-mce-consumer
container_name: datahub-mce-consumer
ports:
Expand Down
8 changes: 4 additions & 4 deletions docker/quickstart/docker-compose.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -176,7 +176,7 @@ services:
- ELASTICSEARCH_PORT=9200

datahub-gms:
image: keremsahin/datahub-gms:latest
image: linkedin/datahub-gms:${DATAHUB_VERSION:-latest}
hostname: datahub-gms
container_name: datahub-gms
ports:
Expand Down Expand Up @@ -205,7 +205,7 @@ services:
java -jar jetty-runner-9.4.20.v20190813.jar gms.war'"

datahub-frontend:
image: keremsahin/datahub-frontend:latest
image: linkedin/datahub-frontend:${DATAHUB_VERSION:-latest}
hostname: datahub-frontend
container_name: datahub-frontend
ports:
Expand All @@ -220,7 +220,7 @@ services:
- datahub-gms

datahub-mae-consumer:
image: keremsahin/datahub-mae-consumer:latest
image: linkedin/datahub-mae-consumer:${DATAHUB_VERSION:-latest}
hostname: datahub-mae-consumer
container_name: datahub-mae-consumer
ports:
Expand All @@ -242,7 +242,7 @@ services:
dockerize -wait http://neo4j:7474 -timeout 240s && java -jar mae-consumer-job.jar'"

datahub-mce-consumer:
image: keremsahin/datahub-mce-consumer:latest
image: linkedin/datahub-mce-consumer:${DATAHUB_VERSION:-latest}
hostname: datahub-mce-consumer
container_name: datahub-mce-consumer
ports:
Expand Down
8 changes: 4 additions & 4 deletions docs/debugging.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,10 +5,10 @@ You can list all Docker containers in your local by running `docker container ls

```
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
979830a342ce keremsahin/datahub-mce-consumer:latest "bash -c 'while ping…" 10 hours ago Up 10 hours datahub-mce-consumer
3abfc72e205d keremsahin/datahub-frontend:latest "datahub-frontend/bi…" 10 hours ago Up 10 hours 0.0.0.0:9001->9001/tcp datahub-frontend
50b2308a8efd keremsahin/datahub-mae-consumer:latest "bash -c 'while ping…" 10 hours ago Up 10 hours datahub-mae-consumer
4d6b03d77113 keremsahin/datahub-gms:latest "bash -c 'dockerize …" 10 hours ago Up 10 hours 0.0.0.0:8080->8080/tcp datahub-gms
979830a342ce linkedin/datahub-mce-consumer:latest "bash -c 'while ping…" 10 hours ago Up 10 hours datahub-mce-consumer
3abfc72e205d linkedin/datahub-frontend:latest "datahub-frontend/bi…" 10 hours ago Up 10 hours 0.0.0.0:9001->9001/tcp datahub-frontend
50b2308a8efd linkedin/datahub-mae-consumer:latest "bash -c 'while ping…" 10 hours ago Up 10 hours datahub-mae-consumer
4d6b03d77113 linkedin/datahub-gms:latest "bash -c 'dockerize …" 10 hours ago Up 10 hours 0.0.0.0:8080->8080/tcp datahub-gms
c267c287a235 landoop/schema-registry-ui:latest "/run.sh" 10 hours ago Up 10 hours 0.0.0.0:8000->8000/tcp schema-registry-ui
4b38899cc29a confluentinc/cp-schema-registry:5.2.1 "/etc/confluent/dock…" 10 hours ago Up 10 hours 0.0.0.0:8081->8081/tcp schema-registry
37c29781a263 confluentinc/cp-kafka:5.2.1 "/etc/confluent/dock…" 10 hours ago Up 10 hours 0.0.0.0:9092->9092/tcp, 0.0.0.0:29092->29092/tcp broker
Expand Down

0 comments on commit ea2377d

Please sign in to comment.