fix: Feed generates error to authorize upload

[davidgamez]

Summary:

When using the feed URL https://www.maricopa-az.gov/home/showpublisheddocument/6491/638307291320330000, it generates an "Error authorizing upload." While verifying the invalid_input_files_in_subfolder notice, an additional request is sent to the producer's URL, causing unexpected behaviors (5XX HTTP code). This PR reuses the response already loaded in memory, avoiding unnecessary external calls and removing the root cause of the original issue.
As part of this PR, the GTFS validator is sending the "User-Agent" header with the value "User-Agent: MobilityData GTFS-Validator/4.2.1 (Java 17.0.6)"

Fixes #1632
Closes #1562

How to reproduce the bug:

1. Run the validator locally
2. Input https://www.maricopa-az.gov/home/showpublisheddocument/6491/638307291320330000"
3. Validate feed
4. System error is generated with the following format:

{
  "notices": [
    {
      "code": "i_o_error",
      "severity": "ERROR",
      "totalNotices": 1,
      "sampleNotices": [
        {
          "exception": "java.io.IOException",
          "message": "Server returned HTTP response code: 503 for URL: https://www.maricopa-az.gov/home/showpublisheddocument/6491/638307291320330000"
        }
      ]
    }
  ]
}

Expected behavior:

The report is generated without generating system errors.

Screenshot of the validation report after fixed:

Please make sure these boxes are checked before submitting your pull request - thanks!

• Run the unit tests with gradle test to make sure you didn't break anything
• Format the title like "feat: [new feature short description]". Title must follow the Conventional Commit Specification(https://www.conventionalcommits.org/en/v1.0.0/).
• Linked all relevant issues
• Include screenshot(s) showing how this pull request works and fixes the issue(s)

[github-actions]

✅ Rule acceptance tests passed.
New Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
New Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
0 out of 1477 sources (~0 %) are corrupted.
Commit: 5b730d3
Download the full acceptance test report here (report will disappear after 90 days).
✅ Rule acceptance tests passed.

[github-actions]

✅ Rule acceptance tests passed.
New Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
New Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
0 out of 1477 sources (~0 %) are corrupted.
Commit: ae465c7
Download the full acceptance test report here (report will disappear after 90 days).
✅ Rule acceptance tests passed.

[github-actions]

✅ Rule acceptance tests passed.
New Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
New Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
0 out of 1477 sources (~0 %) are corrupted.
Commit: c61b68e
Download the full acceptance test report here (report will disappear after 90 days).
✅ Rule acceptance tests passed.

[github-actions]

✅ Rule acceptance tests passed.
New Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
New Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
0 out of 1477 sources (~0 %) are corrupted.
Commit: b919553
Download the full acceptance test report here (report will disappear after 90 days).
✅ Rule acceptance tests passed.

[jcpitre]

After this change hasSubfolderWithGtfsFile(sourceUrl) is not use any more (except in tests). Should we get rid of it?

[davidgamez]

Nice catch! Done, Thanks!

[jcpitre]

LGTM!

[github-actions]

✅ Rule acceptance tests passed.
New Errors: 0 out of 1475 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Errors: 0 out of 1475 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
New Warnings: 0 out of 1475 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Warnings: 0 out of 1475 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
2 out of 1477 sources (~0 %) are corrupted.
Corrupted sources:
es-madrid-metro-de-madrid-gtfs-794
us-new-york-adirondack-trailways-pine-hill-trailways-gtfs-826
Commit: 8f7f4a6
Download the full acceptance test report here (report will disappear after 90 days).
✅ Rule acceptance tests passed.