Skip to content

Jupyter Bootstrap Hangs on AWS EMR #1721

@michaeljfazio

Description

@michaeljfazio

I've written the following CloudFormation script to bootrstrap an EMR cluster on AWS.

https://gist.github.com/michaeljfazio/2fcff1772c9b833af5cb00cc5fbe8e7d

Everything spins up fine except for the Jupyter Notebook bootstrap which seems to hang. Running the script manually after connecting via SSH I see the script gets to this point:

Warning: 'conda-forge' already in 'channels' list, moving to the top
++ /root/conda//bin/conda env update -f /tmp/gw-base.yml
Collecting package metadata (repodata.json): done
Solving environment: |

Another minor observation is that the script does not seem to correctly download the notebook examples as it fails to resolve the bucket token.

+ aws s3 sync s3:///1.1.0/notebooks/jupyter/ /root/notebooks/
fatal error: Parameter validation failed:

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions