Skip to content

gh-109700: Improve stress tests for interpreter creation #109946

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
serhiy-storchaka merged 7 commits into from
May 4, 2025
Merged

gh-109700: Improve stress tests for interpreter creation #109946

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
91af60c
WIP: gh-109700: Make stress tests on interpreter creation more stressful
serhiy-storchaka Sep 27, 2023
18031c9
Use less threads.
serhiy-storchaka Sep 27, 2023
ef226df
Merge branch 'main' into test_interpreters-test_create_many_threaded
serhiy-storchaka Nov 8, 2023
6aecbf9
Mark test_create_many_threaded with bigmemtest.
serhiy-storchaka Nov 8, 2023
fd7cf3c
Merge branch 'main' into test_interpreters-test_create_many_threaded
serhiy-storchaka May 4, 2025
5dd48d6
Add guards also for other stress tests.
serhiy-storchaka May 4, 2025
b3cf0b3
Polishing.
serhiy-storchaka May 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Mark test_create_many_threaded with bigmemtest.
  • Loading branch information
@serhiy-storchaka
serhiy-storchaka committed Nov 8, 2023
commit 6aecbf923374aed3c75003a38afe87d0fbf6ddae
11 changes: 6 additions & 5 deletions Lib/test/test_interpreters.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -591,16 +591,17 @@ def test_create_many_sequential(self):
support.gc_collect()

@support.requires_resource('cpu')
def test_create_many_threaded(self):
@support.bigmemtest(size=6.39*2**30, memuse=1, dry_run=False)
def test_create_many_threaded(self, size):
alive = []
start = threading.Event()
def task():
# try to create all interpreters simultaneously
if not start.wait(10):
raise TimeoutError
for _ in range(20):
interp = interpreters.create()
alive.append(interp)
threads = [threading.Thread(target=task) for _ in range(10)]
interp = interpreters.create()
alive.append(interp)
threads = [threading.Thread(target=task) for _ in range(200)]
with threading_helper.start_threads(threads):
start.set()
del alive
Expand Down