Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(Don't Merge) #14940

Closed
wants to merge 1 commit into from
Closed

(Don't Merge) #14940

wants to merge 1 commit into from

Conversation

calixteman
Copy link
Contributor

No description provided.

@calixteman
Copy link
Contributor Author

/botio-windows integrationtest

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_integrationtest from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/c704649ddfd2340/output.txt

@calixteman
Copy link
Contributor Author

/botio-windows integrationtest

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_integrationtest from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/db2a9d370bee4d0/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Success

Full output at http://54.193.163.58:8877/db2a9d370bee4d0/output.txt

Total script time: 7.44 mins

  • Integration Tests: Passed

@calixteman
Copy link
Contributor Author

Likely a temp failure on github's side.
/botio makeref

@pdfjsbot
Copy link

From: Bot.io (Linux m4)


Received

Command cmd_makeref from @calixteman received. Current queue size: 0

Live output at: http://54.241.84.105:8877/5f3c018d24660b2/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_makeref from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/c0b3e0bb632d4b6/output.txt

@Snuffleupagus
Copy link
Collaborator

Snuffleupagus commented May 19, 2022

Likely a temp failure on github's side.

The thing that failed was the browsertest command, w.r.t. the reftest-analyzer, so I'm not sure that this actually tested the right thing!?

@calixteman
Copy link
Contributor Author

If I understood correctly html_url is a property of the payload from a gh request.
So it should be fine with whatever command.
But I'll test with browsertest to be sure.

@calixteman
Copy link
Contributor Author

/botio browsertest

@pdfjsbot
Copy link

From: Bot.io (Linux m4)


Received

Command cmd_browsertest from @calixteman received. Current queue size: 1

Live output at: http://54.241.84.105:8877/82621fbb5e3361d/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_browsertest from @calixteman received. Current queue size: 1

Live output at: http://54.193.163.58:8877/641ecf2f433b128/output.txt

@pdfjsbot
Copy link

From: Bot.io (Linux m4)


Success

Full output at http://54.241.84.105:8877/5f3c018d24660b2/output.txt

Total script time: 22.53 mins

  • Lint: Passed
  • Make references: Passed
  • Check references: Passed

@pdfjsbot
Copy link

From: Bot.io (Windows)


Success

Full output at http://54.193.163.58:8877/c0b3e0bb632d4b6/output.txt

Total script time: 25.84 mins

  • Lint: Passed
  • Make references: Passed
  • Check references: Passed

@pdfjsbot
Copy link

From: Bot.io (Linux m4)


Failed

Full output at http://54.241.84.105:8877/82621fbb5e3361d/output.txt

Total script time: 21.54 mins

  • Regression tests: FAILED
  different ref/snapshot: 8

Image differences available at: http://54.241.84.105:8877/82621fbb5e3361d/reftest-analyzer.html#web=eq.log

@pdfjsbot
Copy link

From: Bot.io (Windows)


Failed

Full output at http://54.193.163.58:8877/641ecf2f433b128/output.txt

Total script time: 23.55 mins

  • Regression tests: FAILED
  different ref/snapshot: 1

Image differences available at: http://54.193.163.58:8877/641ecf2f433b128/reftest-analyzer.html#web=eq.log

@Snuffleupagus
Copy link
Collaborator

Snuffleupagus commented May 19, 2022

Unfortunately the issue still remains, given that when opening http://54.193.163.58:8877/641ecf2f433b128/reftest-analyzer.html#web=eq.log you cannot actually click on the "firefox-annotation-text-widget-forms-page1"-line and it's thus impossible to review the ref-test failures on the Windows-bot.

@Snuffleupagus
Copy link
Collaborator

It seems that something goes wrong in the following code, but only on the Windows bot:

const match = item.url.match(/\/mozilla\/(.*)/);
text = document.createTextNode(match ? match[1] : item.url);
if (item.images.length > 0) {
const a = document.createElement("a");
a.id = i;
a.className = "image";
a.href = "#";
a.appendChild(text);
td.appendChild(a);
} else {
td.appendChild(text);
}

@calixteman
Copy link
Contributor Author

/botio-windows browsertest

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_browsertest from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/a204f4af6236503/output.txt

@calixteman
Copy link
Contributor Author

/botio-windows browsertest

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_browsertest from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/6c4660bd495a200/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Failed

Full output at http://54.193.163.58:8877/6c4660bd495a200/output.txt

Total script time: 24.79 mins

  • Regression tests: FAILED
  different ref/snapshot: 1

Image differences available at: http://54.193.163.58:8877/6c4660bd495a200/reftest-analyzer.html#web=eq.log

@calixteman
Copy link
Contributor Author

I don't know what the issue is, but at least I can reproduce locally.
I ran a makeref and then a browsertest and I got a lot of TEST-UNEXPECTED-FAIL....
Most of the links in the analyzers are ok but few of them are wrong.

@calixteman
Copy link
Contributor Author

I think understand what the issue is.

So it's why it's failing locally.
When I connected to the VM in using a remote desktop connection, I think (I'm not sure at all) that the remote windows changed its resolution to fit mine, hence the bug...
So the first fix is to fix the regexp and I wonder if we should use window.devicePixelRatio in order to avoid any issue.
I checked the options to connect to the vm and I didn't find anything to fix the remote screen resolution, so I guess that each time I connect it we could have potential issues due to a different outputScale.

@calixteman
Copy link
Contributor Author

/botio makeref

@pdfjsbot
Copy link

From: Bot.io (Linux m4)


Received

Command cmd_makeref from @calixteman received. Current queue size: 0

Live output at: http://54.241.84.105:8877/97cf8578f12d2f4/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_makeref from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/5bc9759294aa068/output.txt

@pdfjsbot
Copy link

From: Bot.io (Linux m4)


Success

Full output at http://54.241.84.105:8877/97cf8578f12d2f4/output.txt

Total script time: 22.24 mins

  • Lint: Passed
  • Make references: Passed
  • Check references: Passed

@pdfjsbot
Copy link

From: Bot.io (Windows)


Success

Full output at http://54.193.163.58:8877/5bc9759294aa068/output.txt

Total script time: 24.35 mins

  • Lint: Passed
  • Make references: Passed
  • Check references: Passed

@calixteman
Copy link
Contributor Author

/botio-windows browsertest

1 similar comment
@calixteman
Copy link
Contributor Author

/botio-windows browsertest

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_browsertest from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/0703623bb319844/output.txt

@calixteman
Copy link
Contributor Author

So the penultimate /botio-windows browsertest failed because of a html_url, I just restarted the process and the last command is ok...

@pdfjsbot
Copy link

From: Bot.io (Windows)


Failed

Full output at http://54.193.163.58:8877/0703623bb319844/output.txt

Total script time: 23.42 mins

  • Regression tests: FAILED
  different ref/snapshot: 1

Image differences available at: http://54.193.163.58:8877/0703623bb319844/reftest-analyzer.html#web=eq.log

@calixteman
Copy link
Contributor Author

/botio-windows browsertest

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_browsertest from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/03e295f0c9084ba/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Failed

Full output at http://54.193.163.58:8877/03e295f0c9084ba/output.txt

Total script time: 21.21 mins

  • Regression tests: FAILED
  different ref/snapshot: 2175

Image differences available at: http://54.193.163.58:8877/03e295f0c9084ba/reftest-analyzer.html#web=eq.log

@calixteman
Copy link
Contributor Author

/botio-windows makeref

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_makeref from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/cf86bfe945256d1/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Success

Full output at http://54.193.163.58:8877/cf86bfe945256d1/output.txt

Total script time: 21.79 mins

  • Lint: Passed
  • Make references: Passed
  • Check references: Passed

@calixteman
Copy link
Contributor Author

/botio-windows browsertest

@pdfjsbot
Copy link

From: Bot.io (Windows)


Received

Command cmd_browsertest from @calixteman received. Current queue size: 0

Live output at: http://54.193.163.58:8877/602a452e6676c5f/output.txt

@pdfjsbot
Copy link

From: Bot.io (Windows)


Failed

Full output at http://54.193.163.58:8877/602a452e6676c5f/output.txt

Total script time: 20.77 mins

  • Regression tests: FAILED
  different ref/snapshot: 1

Image differences available at: http://54.193.163.58:8877/602a452e6676c5f/reftest-analyzer.html#web=eq.log

@timvandermeij
Copy link
Contributor

/botio-linux browsertest

@pdfjsbot
Copy link

pdfjsbot commented Jun 9, 2022

From: Bot.io (Linux m4)


Received

Command cmd_browsertest from @timvandermeij received. Current queue size: 0

Live output at: http://54.241.84.105:8877/e835c65bc13eb8a/output.txt

@pdfjsbot
Copy link

pdfjsbot commented Jun 9, 2022

From: Bot.io (Linux m4)


Failed

Full output at http://54.241.84.105:8877/e835c65bc13eb8a/output.txt

Total script time: 22.20 mins

  • Regression tests: FAILED
  different ref/snapshot: 57

Image differences available at: http://54.241.84.105:8877/e835c65bc13eb8a/reftest-analyzer.html#web=eq.log

@timvandermeij
Copy link
Contributor

/botio-linux makeref

@pdfjsbot
Copy link

From: Bot.io (Linux m4)


Received

Command cmd_makeref from @timvandermeij received. Current queue size: 0

Live output at: http://54.241.84.105:8877/d413ee44fcd9f43/output.txt

@pdfjsbot
Copy link

From: Bot.io (Linux m4)


Success

Full output at http://54.241.84.105:8877/d413ee44fcd9f43/output.txt

Total script time: 22.86 mins

  • Lint: Passed
  • Make references: Passed
  • Check references: Passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants