It is a Simple Web Crawler Implementation.
A web crawler, also known as a spider, is an automated program or script that systematically browses the internet and indexes or downloads content from web pages.
Dependencies:
[dependencies]
rayon = "1.6.1"
reqwest = { version = "0.11.14" , features = ["json","blocking"] }
select = "0.6.0"