url crawler

Python crawler with an HTML dashboard. It checks statuses of URLs for specific rules