Recommendation config s3 for pushing big blobs #4513
Replies: 1 comment 2 replies
-
|
Distribution is more or less limited by AWS S3 API; you should benchmark it, but I'd strongly recommend splitting the large layers into smaller ones. |
Beta Was this translation helpful? Give feedback.
-
|
Good day @milosgajdos , the thing is that some clients use quite large images with large blobs sizes, like pytorch/pytorch, but now there are problems when pushing such images to the local minio. |
Beta Was this translation helpful? Give feedback.
-
|
ok, That said, if you post some errors you are experiencing maybe someone will be able to help you out or give you some tips 🤷♂️ |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Hello, can you tell me what are the recommended parameters from the s3 configuration side, so that the distribution can serve a large number of clients, and also so that it can effectively push images with a large blob size (more than 7 gigabytes per blob). Considering that s3 is not a bottleneck.
At the moment, I use the following parameters, but it seems that the distribution takes a long time to assemble the blob.
Beta Was this translation helpful? Give feedback.
All reactions