Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for histogram filling in oversampled dataset #16740

Open
arizzi opened this issue Oct 24, 2024 · 1 comment
Open

Support for histogram filling in oversampled dataset #16740

arizzi opened this issue Oct 24, 2024 · 1 comment
Assignees
Labels
experiment Affects an experiment / reported by its software & computimng experts new feature

Comments

@arizzi
Copy link
Contributor

arizzi commented Oct 24, 2024

Feature description

As discussed in CHEP24 for CMS FlashSim samples produced with
oversampling a dedicated histo filling scheme is needed where events
are first accumulated on same-gen subevents then used to fill a TH
with proper error handling.
In order to achieve this in a (memory) efficient way the following
features would be needed:

  • know the number of threads actively used and/or which threads will
    not be used at all or any longer in the processing
  • define a global_rdfentry_ that is a progressive number on the inputdataset
  • know what global_rdfentry_ a given thread is processing

An additional useful feature, for handling oversampled events is the
option to have output events in Snapshots sorted according to the
global_rdfentry_ (i.e. maintaining the input order)

Alternatives considered

No response

Additional context

No response

@vepadulano vepadulano added the experiment Affects an experiment / reported by its software & computimng experts label Oct 24, 2024
@vepadulano
Copy link
Member

@arizzi Thank you for the feature request! I am just linking to the related gh issue regarding the global entry number in MT runs #12190

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
experiment Affects an experiment / reported by its software & computimng experts new feature
Projects
None yet
Development

No branches or pull requests

2 participants