Closed
Description
Incompatible versions of elasticsearch and amundsen-search containers
Expected Behavior
- With the command
docker-compose -f docker-amundsen.yml up
amundsen start working seamlessly - Once amundsen is up with neo4j backend one should be able to ingest sample_data
- Amundsen UI should be able to search
- Amundsen UI should be able to bookmark
- Amundsen UI should be able to put together description of columns, tables etc.
Current Behavior
- databuilder/requirements.txt file do not hold dependencies like
psycopg2-binary',
atlas-client`. - Incompatible versions of
elasticsearch
andelasticsearch-dsl
are mentioned that doesn't work withelasticsearch:8.0.0
container (which is mentioned indocker-amundsen.yml
file)
Possible Solution
- Mention missing dependencies in requirements.txt with their compatible versions.
- Update
docker-amundsen.yml
file with compatible versions. likeelasticsearch==7.13.4
,elasticsearch-dsl==7.4.0
,amundsen-common==0.24.1
,amundsen-databuilder==6.4.6
,amundsen-search==3.0.0
Steps to Reproduce
- Run
docker-compose -f docker-amundsen.yml up
- Install python 3.x >= 3.6
- Install python dependencies from
amundsen/databuilder/requirements.txt
directory by runningpip3 install -r requirements.txt
- Run
python3 setup.py install
- Run
python3 example/scripts/sample_data_loader.py
- Now you have to face many problems like
es_amundsen
container not receiving HTTP PUT calls to create new indexes. - When you go on UI no search is possible
- Data partially ingested
Screenshots (if appropriate)
Context
Your Environment
- Amunsen version used: 4.0.2
- Data warehouse stores: elasticsearch:8.0.0 as mentioned in yml file
- Deployment (k8s or native):
- Link to your fork or repository: https://github.com/pankajsoni22/amundsen