Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update spec test suite #2484

Merged
merged 2 commits into from
Nov 30, 2019
Merged

Update spec test suite #2484

merged 2 commits into from
Nov 30, 2019

Conversation

aheejin
Copy link
Member

@aheejin aheejin commented Nov 28, 2019

This updates spec test suite to that of the current up-to-date version
of https://github.com/WebAssembly/spec repo.

  • All failing tests are added in BLACKLIST in shared.py with reasons.
  • For tests that already existed and was passing and started failing
    after the update, we add the new test to the blacklist and preserve
    the old file by renaming it to 'old_[FILENAME].wast' not to lose test
    coverage. When the cause of the error is fixed or the unsupported
    construct gets support so the new test passes, we can delete the
    corresponding 'old_[FILENAME].wast' file.
  • Adds support for `spectest.print_[type] style imports.

This updates spec test suite to that of the current up-to-date version
of https://github.com/WebAssembly/spec repo.

- All failing tests are added in `BLACKLIST` in shared.py with reasons.
 - For tests that already existed and was passing and started failing
   after the update, we add the new test to the blacklist and preserve
   the old file by renaming it to 'old_[FILENAME].wast' not to lose test
   coverage. When the cause of the error is fixed or the unsupported
   construct gets support so the new test passes, we can delete the
   corresponding 'old_[FILENAME].wast' file.
- Adds support for `spectest.print_[type] style imports.
@aheejin aheejin requested a review from kripken November 28, 2019 02:41
Copy link
Member

@kripken kripken left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@aheejin aheejin merged commit 24d2749 into WebAssembly:master Nov 30, 2019
@aheejin aheejin deleted the update_spec branch November 30, 2019 02:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants