-
Notifications
You must be signed in to change notification settings - Fork 962
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
This change makes a number of major changes: - Colab is the base image - uv is the main package install tool - leveraging requirements.txt instead of many separate installs - stop building and installing tensorflow/torch/lightbgm/jax since those are managed by the Colab base image now In order to decide what packages to explicitly install I: - looked at what packages are in the Colab base image - looked at what packages were in the Kaggle image - looked at what packages were explicitly mentioned in Kaggle Dockerfile This may still take a few iterations to get all the right parts in the image, but this should hopefully make the image much more manageable. http://b/365782129
- Loading branch information
Showing
9 changed files
with
228 additions
and
598 deletions.
There are no files selected for viewing
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,11 +1,2 @@ | ||
BASE_IMAGE_REPO=gcr.io/deeplearning-platform-release | ||
BASE_IMAGE_TAG=m122 | ||
CPU_BASE_IMAGE_NAME=tf2-cpu.2-16.py310 | ||
GPU_BASE_IMAGE_NAME=tf2-gpu.2-16.py310 | ||
LIGHTGBM_VERSION=4.2.0 | ||
TORCH_VERSION=2.4.0 | ||
TORCHAUDIO_VERSION=2.4.0 | ||
TORCHVISION_VERSION=0.19.0 | ||
JAX_VERSION=0.4.26 | ||
CUDA_MAJOR_VERSION=12 | ||
CUDA_MINOR_VERSION=3 | ||
CUDA_MINOR_VERSION=2 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,139 @@ | ||
altair>=5.4.0 | ||
Babel | ||
Boruta | ||
Cartopy | ||
ImageHash | ||
Janome | ||
PyArabic | ||
PyUpSet | ||
Pympler | ||
Rtree | ||
shapely<2 | ||
SimpleITK | ||
TPOT | ||
Theano | ||
Wand | ||
annoy | ||
arrow | ||
bayesian-optimization | ||
boto3 | ||
catboost | ||
category-encoders | ||
cesium | ||
comm | ||
cytoolz | ||
dask-expr | ||
datasets | ||
datashader | ||
deap | ||
dipy | ||
docker | ||
easyocr | ||
eli5 | ||
emoji | ||
fasttext | ||
featuretools | ||
fiona | ||
fury | ||
fuzzywuzzy | ||
geojson | ||
# geopandas > v0.14.4 breaks learn tools | ||
geopandas==v0.14.4 | ||
google-cloud-aiplatform | ||
# google-cloud-automl 2.0.0 introduced incompatible API changes, need to pin to 1.0.1 | ||
google-cloud-automl==1.0.1 | ||
# b/315753846: Unpin translate package. | ||
google-cloud-translate==3.12.1 | ||
google-cloud-videointelligence | ||
google-cloud-vision | ||
gpxpy | ||
h2o | ||
haversine | ||
hep-ml | ||
igraph | ||
ipympl | ||
ipywidgets==8.1.5 | ||
isoweek | ||
jedi | ||
# b/276358430: fix Jupyter lsp freezing up the jupyter server | ||
jupyter-lsp==1.5.1 | ||
# b/333854354: pin jupyter-server to version 2.12.5; later versions break LSP (b/333854354) | ||
jupyter_server==2.12.5 | ||
jupyterlab | ||
jupyterlab-lsp | ||
kaggle-environments | ||
kagglehub>=0.3.4 | ||
# Keras 3.6 broke test_keras.py > test_train > keras.datasets.mnist.load_data(): | ||
# See https://github.com/keras-team/keras/commit/dcefb139863505d166dd1325066f329b3033d45a | ||
keras<3.6 | ||
keras-cv | ||
keras-nlp | ||
keras-tuner | ||
kornia | ||
langid | ||
leven | ||
# b/328788268: libpysal 4.10 seems to fail with "module 'shapely' has no attribute 'Geometry'. Did you mean: 'geometry'" | ||
libpysal<=4.9.2 | ||
lime | ||
line_profiler | ||
mamba | ||
mlcrate | ||
mne | ||
mpld3 | ||
nbdev | ||
nilearn | ||
olefile | ||
onnx | ||
openslide-bin | ||
openslide-python | ||
optuna | ||
pandas-profiling | ||
pandasql | ||
papermill | ||
path | ||
path.py | ||
pdf2image | ||
plotly-express | ||
preprocessing | ||
pudb | ||
pyLDAvis | ||
pycryptodome | ||
pydegensac | ||
pydicom | ||
pydub | ||
pyemd | ||
pyexcel-ods | ||
pymc3 | ||
pymongo | ||
pypdf | ||
pytesseract | ||
python-lsp-server | ||
pytorch-ignite | ||
pytorch-lightning | ||
qgrid | ||
qtconsole | ||
ray | ||
rgf-python | ||
s3fs | ||
scikit-learn-intelex | ||
scikit-multilearn | ||
scikit-optimize | ||
scikit-plot | ||
scikit-surprise | ||
git+https://github.com/facebookresearch/segment-anything.git | ||
shap | ||
squarify | ||
tensorflow-cloud | ||
tensorflow-io | ||
tensorflow-text | ||
tensorflow_decision_forests | ||
timm | ||
torchinfo | ||
torchmetrics | ||
tsfresh | ||
vtk | ||
wandb | ||
wavio | ||
xgboost==2.0.3 | ||
xvfbwrapper | ||
ydata-profiling |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters