Skip to content

[CIVIS-9806] ENH update civis-python to v2.4.0; add uv#99

Merged
jacksonlee-civis merged 13 commits into
masterfrom
civis-9806-civis-python-v2.4.0-release
Nov 18, 2024
Merged

[CIVIS-9806] ENH update civis-python to v2.4.0; add uv#99
jacksonlee-civis merged 13 commits into
masterfrom
civis-9806-civis-python-v2.4.0-release

Conversation

@jacksonlee-civis

Copy link
Copy Markdown
Member

We've just released civis-python v2.4.0, so it's time for another round of updating the datascience-python image. Summary of changes from the updated changelog:

  • Python version updated to v3.12.7
  • Core dependencies updated to latest versions:
    • awscli 2.17.37 -> 2.19.5
    • boto3 1.34.127 -> 1.35.58
    • civis 2.3.0 -> 2.4.0
    • numpy 2.0.0 -> 2.1.3
    • pandas 2.2.2 -> 2.2.3
    • scikit-learn 1.5.0 -> 1.5.2
    • scipy 1.13.1 -> 1.14.1
  • uv added to the image

  • (For Civis employees only) Reference to a relevant ticket in the pull request title
  • Changelog entry added to CHANGELOG.md at the repo's root level
  • Description of change in the pull request description
  • If applicable, unit tests have been added and/or updated
  • The CircleCI builds have all passed

Comment thread Dockerfile
Comment on lines -51 to -56
# Install the AWSCLI for moving match targets in the QC workflow.
# See https://docs.aws.amazon.com/cli/latest/userguide/getting-started-install.html#cliv2-linux-install
RUN curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip" && \
unzip awscliv2.zip && \
./aws/install && \
rm -rf aws awscliv2.zip

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Now specifying awscli in requirements-core.txt instead, see below

# It uses Docker to ensure that the environment matches what will be used in the production image.
set -e
docker compose run --rm pip-tools /bin/sh -c "pip install --upgrade pip-tools && pip-compile --output-file=requirements-full.txt --pip-args='--prefer-binary' --strip-extras --upgrade requirements-core.txt"
docker compose run --rm pip-tools /bin/sh -c "apt-get update -y && apt-get install -y git && pip install --upgrade pip-tools && pip-compile --output-file=requirements-full.txt --pip-args='--prefer-binary' --strip-extras --upgrade requirements-core.txt"

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need git for installing awscli from its github source

@jacksonlee-civis jacksonlee-civis changed the title [CIVIS-9806] ENH update civis-python to v2.4.0 release; add uv [CIVIS-9806] ENH update civis-python to v2.4.0; add uv Nov 12, 2024
@jacksonlee-civis

jacksonlee-civis commented Nov 12, 2024

Copy link
Copy Markdown
Member Author

The CircleCI build has passed, but I'm switching this pull request to the "draft" status as I'm running tests internally on Civis Platform. Once this PR is ready for review, I'll tag you @Drew-Pappas (going to spread out the workload instead of tagging Drew all the time 😄)

@jacksonlee-civis jacksonlee-civis self-assigned this Nov 12, 2024
@jacksonlee-civis jacksonlee-civis force-pushed the civis-9806-civis-python-v2.4.0-release branch 8 times, most recently from 87248ef to 97aa76d Compare November 13, 2024 04:55
@jacksonlee-civis jacksonlee-civis force-pushed the civis-9806-civis-python-v2.4.0-release branch from 97aa76d to b4d198b Compare November 13, 2024 05:14
@jacksonlee-civis jacksonlee-civis requested review from margaretott and removed request for Drew-Pappas November 14, 2024 15:45
@jacksonlee-civis jacksonlee-civis marked this pull request as ready for review November 14, 2024 15:45

@margaretott margaretott left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@jacksonlee-civis jacksonlee-civis merged commit 15253e3 into master Nov 18, 2024
@civis-robot

Copy link
Copy Markdown

Pull Request Merged!!! This build is running now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants