[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DB12 shows error when using Python 3.11 #7267

Open
chrisburr opened this issue Nov 2, 2023 · 4 comments
Open

DB12 shows error when using Python 3.11 #7267

chrisburr opened this issue Nov 2, 2023 · 4 comments
Assignees

Comments

@chrisburr
Copy link
Member

In an LHCb pilot stderr I noticed these warnings:

2023-11-02 13:53:14 UTC ExternalLibrary/root WARN: You are executing DB12 using python3, DB12 score is generally higher than it was with python2
2023-11-02 13:53:14 UTC ExternalLibrary/root WARN: Trying to apply a correction...
2023-11-02 13:53:14 UTC ExternalLibrary/root WARN: Cannot correct the score, return the raw norm: the python version 3.11 has not been analyzed.
2023-11-02 13:53:14 UTC ExternalLibrary/root WARN: Versions available are: 3.9
2023-11-02 13:53:14 UTC ExternalLibrary/root WARN: Please consult https://zenodo.org/record/5647834 for further details
@fstagni
Copy link
Contributor
fstagni commented Nov 2, 2023

It is known. Maybe @EwoudK wants to have a look?

@EwoudK
Copy link
EwoudK commented Nov 6, 2023

I did not yet add the new correction factors to the DB12 scripts. I will have a look to add them.

@aldbr
Copy link
Contributor
aldbr commented Nov 7, 2023

I made an analysis a few months ago with the jupyter notebook I created here (I needed to tweak it a bit) https://zenodo.org/records/5647834

I got the following results:
image

By applying a factor of 0.83, I got the following results:
image

@EwoudK I can send you the raw results if you want (db12 running on many different sites with python 3.9 and python3.11).

Now, I wonder if this is the right approach as:

  • we need to perform this analysis and update the code every time there is a new minor version of Python.
  • it does not protect jobs from old productions to run out of time
  • we saw that the raw DB12 value using Python3 was actually better than the DB12 value using Python2 on AMD processors

What is really important is to make sure that DB12 still sticks to the MC Simulation jobs: https://zenodo.org/records/7199144

To prevent jobs from old productions from running out of time, a solution could consist in constantly updating the CPUe (CPU work / event: the average CPU work of one event of a production).
In LHCb, this is computed once, before a production becomes active, by the MCSimulationTestingAgent, on a small set of computing resources from a single site.
This should probably be computed each time a job is done.

@EwoudK
Copy link
EwoudK commented Nov 8, 2023

@aldbr That could be useful.
This summer, I investigated the DB12 scores compared to the LHCb workload in HEPSuite in order to calculate a correction factor for DB12.

I should check but I think the data I gathered for this were exclusively with Python 3.11. If this is the case, should I add the correction factors I computed as the ones for Python 3.11 or rather as general correction factors?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants