GitHub - Ishuin/web_crawler: Web crawler designed in Python

Web Crawler designed in Python 3.7.

Change value of the "HOMEPAGE" field in the main.py file to crawl required website.

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.idea		.idea
__pycache__		__pycache__
thesite		thesite
venv		venv
README.md		README.md
demo.py		demo.py
domain.py		domain.py
link_finder.py		link_finder.py
main.py		main.py
spider.py		spider.py

Provide feedback