Open
Description
Environment
- How did you deploy Kubeflow Pipelines (KFP)?
Kubeflow pipelines standalone, AWS setup
Steps to reproduce
Open your network panel in dev tools. Navigate to the Runs page and look at your network console. Try to increase page size in the UI, and see many requests.
When navigating to the "Runs" page, kubeflow will send an API call to fetch a list of runs. There are two problems here:
- This query returns a
total_size
field, which does unneeded COUNT(*) query on the whole "run_details" table, the count is not even displayed in the UI. - More important, after the run list is fetched, the UI will do an API call per run (which is a DB query) to get its associated pipeline. This is very slow. Instead, the runs API could simply do an SQL JOIN to get the pipeline info.
This is really slow, even for page size of 10, tested with my medium size RDS instance. When page size is 100, this page will do over 100 SQL queries.
Expected result
To get the runs data with the pipeline info, one query should be enough. Page should load faster.
Materials and Reference
Impacted by this bug? Give it a 👍.
Activity