Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unexpected number of partitions with multiple files #1273

Open
alexander-held opened this issue Aug 15, 2024 · 0 comments
Open

Unexpected number of partitions with multiple files #1273

alexander-held opened this issue Aug 15, 2024 · 0 comments
Labels
bug (unverified) The problem described would be a bug, but needs to be triaged

Comments

@alexander-held
Copy link
Member

alexander-held commented Aug 15, 2024 •
edited
Loading

When opening a single file with uproot.dask(..., steps_per_file=1) I see one partition as expected. Opening two such files creates an object with three partitions:

prefix = "https://xrootd-local.unl.edu:1094//store/user/AGC/nanoAOD/TT_TuneCUETP8M1_13TeV-powheg-pythia8/"
fname_1 = prefix + "cmsopendata2015_ttbar_19980_PU25nsData2015v1_76X_mcRun2_asymptotic_v12_ext3-v1_00000_0000.root"
fname_2 = prefix + "cmsopendata2015_ttbar_19980_PU25nsData2015v1_76X_mcRun2_asymptotic_v12_ext3-v1_00000_0001.root"

evts_1 = uproot.dask({fname_1: "Events"}, steps_per_file=1)
assert evts_1.npartitions == 1

evts_2 = uproot.dask({fname_1: "Events"}, steps_per_file=1)
assert evts_2.npartitions == 1

evts_1_and_2 = uproot.dask({fname_1: "Events", fname_2: "Events"}, steps_per_file=1)
print(evts_1_and_2.npartitions)

-> prints 3

I would have expected two partitions to be created here (the sum over both files). Am I misunderstanding the intended behavior or is this a bug? I am using uproot version 5.3.10.
@alexander-held alexander-held added the bug (unverified) The problem described would be a bug, but needs to be triaged label Aug 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug (unverified) The problem described would be a bug, but needs to be triaged
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@alexander-held