You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardexpand all lines: README.md
+7-1
Original file line number
Diff line number
Diff line change
@@ -3,6 +3,12 @@ Playwright scraper and crawler
3
3
4
4
# Versions and Differences
5
5
6
-
BFS version
6
+
**BFS version**
7
7
The BFS version uses the Breadth-First Search Approach
8
8
To ensure the crawler explores all pages more thoroughly the crawler processes all immediate links (siblings) at the current depth level before moving on to deeper levels.
9
+
10
+
**Scrape Everything**
11
+
This pretty much lets the crawler to go wild (can't recommend)
12
+
13
+
**Scrape Domain Scope only**
14
+
Scrapes within the domain scope (worse BFS version as this goes in a straight line and doesn't scan everything)
0 commit comments