Skip to content

Speed up with the Proof#3

Open
jhgoh wants to merge 1 commit intoHEP-HYU:heptoolsfrom
jhgoh:useProof
Open

Speed up with the Proof#3
jhgoh wants to merge 1 commit intoHEP-HYU:heptoolsfrom
jhgoh:useProof

Conversation

@jhgoh
Copy link

@jhgoh jhgoh commented Jan 20, 2017

Proof is a framework to use multiple CPU in the ROOT.
Faster analysis can be done with this extension.

In ideal case, processing time should be reduced by the number of processes, but there are other factors such as disk I/O and memory usage
The optimal choice for the number of jobs seems to be around workers=8, a significant performance drop is observed with large value due to memory consumption.
From the HYU computing node, it took 5min, x4 faster than the single CPUs.

missing file
avoid crash in proof mode
missing cleanup
working dir from envvar
reduce n. of process
avoid crash in single CPU mode
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant