Skip to content

Amunsen crashes because yaml file has incompatible versions mentioned #2160

Closed
@pankajsoni22

Description

@pankajsoni22

Incompatible versions of elasticsearch and amundsen-search containers

Expected Behavior

  1. With the command docker-compose -f docker-amundsen.yml up amundsen start working seamlessly
  2. Once amundsen is up with neo4j backend one should be able to ingest sample_data
  3. Amundsen UI should be able to search
  4. Amundsen UI should be able to bookmark
  5. Amundsen UI should be able to put together description of columns, tables etc.

Current Behavior

  1. databuilder/requirements.txt file do not hold dependencies like psycopg2-binary', atlas-client`.
  2. Incompatible versions of elasticsearch and elasticsearch-dsl are mentioned that doesn't work with elasticsearch:8.0.0 container (which is mentioned in docker-amundsen.yml file)

Possible Solution

  1. Mention missing dependencies in requirements.txt with their compatible versions.
  2. Update docker-amundsen.yml file with compatible versions. like elasticsearch==7.13.4, elasticsearch-dsl==7.4.0, amundsen-common==0.24.1, amundsen-databuilder==6.4.6, amundsen-search==3.0.0

Steps to Reproduce

  1. Run docker-compose -f docker-amundsen.yml up
  2. Install python 3.x >= 3.6
  3. Install python dependencies from amundsen/databuilder/requirements.txt directory by running pip3 install -r requirements.txt
  4. Run python3 setup.py install
  5. Run python3 example/scripts/sample_data_loader.py
  6. Now you have to face many problems like es_amundsen container not receiving HTTP PUT calls to create new indexes.
  7. When you go on UI no search is possible
  8. Data partially ingested

Screenshots (if appropriate)

Context

Your Environment

Metadata

Metadata

Assignees

No one assigned

    Labels

    stalestatus:needs_triageFor all issues that need to be processedtype:bugAn unexpected problem or unintended behavior

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions