A website crawler, also known as a spider or bot, is a tool that automatically scans a website and follows links to discover all of its pages.
Can edit on terminal via nano main.rb or vim main.rb Run the file with ruby main.rb command
-
Notifications
You must be signed in to change notification settings - Fork 0
agam1092005/website_crawler
About
A website crawler, also known as a spider or bot, is a tool that automatically scans a website and follows links to discover all of its pages.
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published