Skip to content
This repository was archived by the owner on Jul 15, 2024. It is now read-only.

refactor(tests): refactor into split tests#164

Merged
chingor13 merged 1 commit into
masterfrom
split-tests
Jun 23, 2020
Merged

refactor(tests): refactor into split tests#164
chingor13 merged 1 commit into
masterfrom
split-tests

Conversation

@chingor13

@chingor13 chingor13 commented Jun 23, 2020

Copy link
Copy Markdown
Contributor
  • Each client is now tested separately.
  • For clients that create resources, we now use a common pattern of
    maintaining a multiset of resource identifiers to clean up at the end of
    the test class.
  • For operations that create resources, we now use the functionality to
    wait on operations rather than sleeping. This cuts the integration test time
    from 20 minutes to under 10 minutes.
  • If an operation fails, we will fail the test (or setup)

Turns out that we were silently hitting quota limits. Because we now check the status of the long running operations, we will actually be able to see the quota issue rather than a failing test that tries to find the resource.

Fixes #165

@googlebot googlebot added the cla: yes This human has signed the Contributor License Agreement. label Jun 23, 2020
@codecov

codecov Bot commented Jun 23, 2020

Copy link
Copy Markdown

Codecov Report

Merging #164 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff            @@
##             master     #164   +/-   ##
=========================================
  Coverage     37.30%   37.30%           
  Complexity    14431    14431           
=========================================
  Files          1574     1574           
  Lines        182845   182845           
  Branches      26931    26931           
=========================================
  Hits          68207    68207           
  Misses       106719   106719           
  Partials       7919     7919           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7ad4d75...8f85f2b. Read the comment docs.

* Each client is now tested separately.
* For clients that create resources, we now use a common pattern of
maintaining a multiset of resource identifiers to clean up at the end of
the test class.
* For operations that create resources, we now use the functionality to
wait on operations rather than sleeping.
* If an operation fails, we will fail the test (or setup)
@chingor13 chingor13 merged commit 4b0912a into master Jun 23, 2020
@chingor13 chingor13 deleted the split-tests branch June 23, 2020 23:11
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

cla: yes This human has signed the Contributor License Agreement.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integration tests are flaky

3 participants