Browsertix Crawler 0.9.0 Beta 1
Pre-release
Pre-release
Major Changes
- Removed puppeteer cluster
- BREAKING: Switched from Puppeteer to Playwright. Custom drivers would need to be migrated, see: https://playwright.dev/docs/puppeteer
or https://github.com/checkly/puppeteer-to-playwright tool - Always using Redis-based priority queue for crawl state
What's Changed
- logging: serialize regex as string to avoid empty '{}' when logging s… by @ikreymer in #235
- Remove puppeteer-cluster by @tw4l in #219
- Fix size check by @ikreymer in #241
- Add timedRun to prevent async operations from hanging by @tw4l in #243
- Add total timeout + limit redis queue retries by @ikreymer in #248
- Minor crawler fixes after puppeteer-cluster removal refactoring by @tw4l in #250
- Dev 0.9.0 Beta 1 Work - Playwright Removal + Worker Refactor + Redis State by @ikreymer in #253
- Logger cleanup by @ikreymer in #254
- Catch loading issues by @ikreymer in #255
- Add option for sleep interval after behaviors run by @tw4l in #257
Full Changelog: 0.8.1...0.9.0-beta.1