Generalize makeTrackValidationPlots.py script

[makortel]

This PR generalizes the makeTrackValidationPlots.py script introduced in #9882 to make plots for all subfolders of "Tracking/Track" folder of the first of the DQM files given as command line arguments (feature requested by @lveldere). Add also --ignoreMissing command line flag to allow skipping missing histograms/subfolders.

In addition, switch the plotting to use the profile histograms in the DQM files instead of the 2D histograms nhits_vs_eta and chi2_vs_eta that were cleaned up in #9524.

There should be no effect on standard workflows.

@rovere @VinInn

[cmsbuild]

A new Pull Request was created by @makortel (Matti Kortelainen) for CMSSW_7_6_X.

Generalize makeTrackValidationPlots.py script

It involves the following packages:

Validation/RecoTrack

@cmsbuild, @danduggan, @deguio can you please review it and eventually sign? Thanks.
@GiacomoSguazzoni, @rovere, @VinInn, @appeltel, @cerati, @wmtford, @istaslis, @dgulhan this is something you requested to watch as well.
You can sign-off by replying to this message having '+1' in the first line of your reply.
You can reject by replying to this message having '-1' in the first line of your reply.
If you are a L2 or a release manager you can ask for tests by saying 'please test' in the first line of a comment.
@Degano you are the release manager for this.
You can merge this pull request by typing 'merge' in the first line of your comment.

[makortel]

Noticed a small bug right after pushing "submit PR" button, fixed and squashed to the existing commit.

[cmsbuild]

Pull request #9949 was updated. @cmsbuild, @danduggan, @deguio can you please check and sign again.

[lveldere]

Hi Matti

I have some troubles running this.
I've put 2 DQM files in ~lveldere/public/matti

I run

./Validation/RecoTrack/scripts/makeTrackValidationPlots.py fullsim_harvest.root fastsim_harvest.root

This complaints about some histograms not found.
Which I fixed by setting drawArgs["ignoreMissing"] = True,
but after that I still don't get pdf files...

Thanks

Lukas

[makortel]

Thanks, I'll take a look (and close this for time being).

[makortel]

@lveldere The missing histograms were due to 2D-histograms nhits_vs_eta and chi2_vs_eta that were cleaned up in #9524. As they were used only to make "ProfileX()", I switched the plotting to use the profiles existing in DQM file (should've done this in #9524...). In addition, I added --ignoreMissing flag to makeTrackValidationPlots.py that allows the script to continue making plots if some histograms/folders are missing (e.g. your example fastsim-file does not have jetCoreRegionalStepSeeds_quickAssociatorByHits folder), and made sure to loop over only subdirectories of Tracking/Track (#9201 added also summary histograms there).

[cmsbuild]

Pull request #9949 was updated. @cmsbuild, @danduggan, @deguio can you please check and sign again.

[lveldere]

Great, that works! Thanks.

[deguio]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_7_6_X IBs or unless it breaks tests. This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @Degano, @smuzaffar