Skip to content

Commit 0fa9f70

Browse files
authored
Added everything to readme
1 parent 635dcf2 commit 0fa9f70

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

README.md

+7-1
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,12 @@ Playwright scraper and crawler
33

44
# Versions and Differences
55

6-
BFS version
6+
**BFS version**
77
The BFS version uses the Breadth-First Search Approach
88
To ensure the crawler explores all pages more thoroughly the crawler processes all immediate links (siblings) at the current depth level before moving on to deeper levels.
9+
10+
**Scrape Everything**
11+
This pretty much lets the crawler to go wild (can't recommend)
12+
13+
**Scrape Domain Scope only**
14+
Scrapes within the domain scope (worse BFS version as this goes in a straight line and doesn't scan everything)

0 commit comments

Comments
 (0)