feat: start of e2e testing

[dustinwloring1988]

Testing with playwright:

• updated documentation
• all tests passing
• requirements playwright

simple to use and generate a html report with screenshots if the test fails.

[dustinwloring1988]

@thecodacus @coleam00
Are we interested in doing tests like this, if not no worries I will just close this?

[coleam00]

@thecodacus @coleam00 Are we interested in doing tests like this, if not no worries I will just close this?

Yeah we talked about wanting to do Playwright tests for a while so this looks great!

[AriPerkkio]

FYI, if you want these tests to have stable output from the LLM, you could use MSW to intercepts the HTTP calls done on server side. The e2e tests should inject a new Remix route that exposes APIs for controlling MSW that's running on server. That MSW should be configured to intercept all the LLM provider's endpoints you wish to mock. Then you could control the mocks inside each Playwright test, e.g. make the LLM return certain index.html that's then asserted to be visible on preview.

Related to mswjs/msw#1668

[thecodacus]

@thecodacus @coleam00 Are we interested in doing tests like this, if not no worries I will just close this?

Looks great, I have very little experience on browser testing. but looks good to me. but like @AriPerkkio said we can intercept and mock the llm calls and provide maybe a predictable hardcoded outputs so that we can test all the features with a all the edge cases for different llm outputs

[thecodacus]

I believe @mrsimpson can review this better than me