Update ASF "stash" action to allow list of keys #45268
Labels
area:dev-env
CI, pre-commit, pylint and other changes that do not change the behavior of the final code
area:dev-tools
Comments
dosubot
bot
added
area:dev-env
|
So you would want the action to be able to download multiple 'stash' artifacts and unpack them into a single dir? I can see how this would be useful to simplify this: https://github.com/apache/airflow/pull/45266/files#diff-a2dbc854d7d9f769ffe6efe98247baa68750cba87d785fb70d4616331010c7d0R43 The main motivation for the action was caching compiler caches for which this doesn't really make sense but when used as a more general |
|
Yeah. That's the main motivation - to avoid hard-coding of the conditional cache retrieval :) .. We might have either me or someone from our team to contribute that. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
In the new "caching" mechanism we are using "stash" GitHub action from @assignUser which only allows one key per action.
The action is in https://github.com/apache/infrastructure-actions/tree/main/stash
This is a a limiting factor when we want to download artifacts with a dynamic list of keys coming from a variable (say list of keys derived python versions - "3.9 3.10 3.11 3.12" -> "key-3.9 key-3.10 key-3.11 key-3.12".
Currently in #45266 (https://gtithub.com/apache/airflow/pull/45266/files#diff-a2dbc854d7d9f769ffe6efe98247baa68750cba87d785fb70d4616331010c7d0) we are hard-coding the possible actions to run with parameters and we are skipping those that are not on the list, but this is more of a hack than target solution.
Ideally we should be able to pass
keysparameter to the action instead ofkeyand be able to produce "hit-keys" list as output - then we could generate and pass the list of keys as input.The text was updated successfully, but these errors were encountered: