-
Notifications
You must be signed in to change notification settings - Fork 286
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test plot #2141
Test plot #2141
Conversation
@marqh Unfortunately, I'm 👎 on this PR. I understand your motivation to purge both
However,
If we can address the I think it would be very valuable for other @SciTools/iris-devs opinion here ... |
I'd like to disagree with this perspective. The motivation behind this change is to make it easier to lessen our version pinning because of check_graphic. I believe that all solutions to check_graphic improvements so far involve some degree of image maintenance and analysis, and this make me feel that the more we use such an approach, the more we will struggle to implement a solution without it having significant knock on consequences. I think that this approach is a key part of the work to
i think that this is a key enabling factor in allowing work to take place to make check_graphic more flexible whilst still useful. I fear that without a change of this style then we won't be able to get a good solution to check_graphic, due to the scale of issue it will need to solve. So, if the nub of the worry is
how do we address this? @bjlittle if this were addressed, would you be content with the approach? |
Finish #2151, most probably. |
I'm in agreement with @bjlittle here. As it stands, this PR is not mergable. I think we all want to see shorter test run time, and I agree with the approach you have taken in #2139 in reducing the tests on individual merit (although @QuLogic's comment about Anscome's quartet is extremely pertinent). |
Removal of
these are already widely unit tested
Moved
to
and altered a few tests to use quickplot instead of plot
these are better integration tests, looking at Iris, cartopy and matplotlib together
I assert that this change set makes a small impact to our test coverage, the plot code is still well tested, with wide spread unit testing in place and a sensible set of integration tests.
The example gallery also provides integration level testing of example code, producing plots