Skip DANDI upload to allow tests to pass with broken external services

[garrettmflynn]

Skip the DANDI upload part of the E2E tests to avoid failing when external dependencies (e.g. the DANDI server) has an issue.

[CodyCBakerPhD]

What I'm requesting is that we split the current testing action into two actions; one that runs only the live service tests like DANDI upload, and one that runs only the non-live service tests that we can control

These would show up as two separate CI runs on a PR, and yes the live one would continue to fail until DANDI fixes their end

[garrettmflynn]

Sure. Though since this DANDI upload test is at the very end of the E2E workflow and requires a complete pipeline to finish, would it be sufficient to simply duplicate the testing.yml + keep the DANDI_STAGING_API that was removed here?

We could cache a complete pipeline instead, though that'll take a bit longer.

[CodyCBakerPhD]

Though since this DANDI upload test is at the very end of the E2E workflow and requires a complete pipeline to finish,

I see

would it be sufficient to simply duplicate the testing.yml + keep the DANDI_STAGING_API that was removed here?

that would be fine

Yes, a fancier/more efficient approach would either be to cache the output and go direct to upload or use a couple lines of PyNWB to generate a minimal file and do standalone upload of that - but these aren't entirely necessary

[garrettmflynn]

Alright added that extra testing file