Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recordstream files aren't processed in the correct order #110

Closed
gregscullard opened this issue Aug 27, 2019 · 0 comments · Fixed by #111
Closed

Recordstream files aren't processed in the correct order #110

gregscullard opened this issue Aug 27, 2019 · 0 comments · Fixed by #111
Assignees
Labels
bug Type: Something isn't working downloader Area: S3 downloader P1
Milestone

Comments

@gregscullard
Copy link
Contributor

When running the downloader separate from the parser, the parser sometimes processes files out of order.

This is because the downloader sets up a list of files which can end up being unsorted, resulting in files being written to /valid in the wrong order.

@gregscullard gregscullard added bug Type: Something isn't working OABlocker labels Aug 27, 2019
@gregscullard gregscullard self-assigned this Aug 27, 2019
steven-sheehy pushed a commit that referenced this issue Aug 27, 2019
* Update RecordFileDownloader.java

* Update RecordFileDownloader.java
@steven-sheehy steven-sheehy added this to the 0.1.0 milestone Aug 27, 2019
@steven-sheehy steven-sheehy added downloader Area: S3 downloader P1 labels Nov 26, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Type: Something isn't working downloader Area: S3 downloader P1
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants