Best Flask open-source libraries and packages

Dashboard scraping coronavirus

Web scraping coronavirus data from the Worldometers website and visualizing by deploying a dashboard.
Updated 1 year ago

Coronavirus Scraping Dashboard

Table of Contents
  1. About The Project
  2. Set up
  3. Contributing
  4. Contact

About the projet

In this project, we will be reviewing an application for automating web scraping of newest health advice from the World Health Organization from the Worldometers website and visualize data concerning COVID-19 by depoying a dashboard.

Link to the application deployed in Heroku : @covid-dashboard : https://ettabaa-hajar-covid.herokuapp.com/

We have 3 main files :

  1. get_data.py : scraping data using Selenium.
  2. dashboard.py : visualising figures of the dashboard.
  3. index.html : HTML code of the dashboard

Built With

This project was built using :

Set up

You can clone this public repository by entering the following command into terminal :

git clone https://github.com/hetta-14/dashboard-scraping-coronavirus/

Prerequisites

Once you've download the code you should install needed libs by typing the command :

sudo pip install -r requirements.txt

All the libraries with their specified versions can be found in this file.

Web scraping

We will recover the data scraped from the site https://www.worldometers.info/coronavirus/ by entering the following command :

python get_data.py

Selenium launches and controls the web browser. The webdriver "chromedriver.exe" manages the browser by Selenium.

Note :

  • Before scraping, read the website terms and conditions at robots.txt to understand how you can legally use the data. Most of sites prohibit you from using the data for commercial purposes.
  • Be sure not to download the data too quickly, as this may damage the website. You could also be blocked from the site.

Launching the dashboard visualization

Using Plotly, we are going to plot and visualize the figures from the scraped data with the following command :

python dashboard.py

The following figures represent a snippet of the dashboard visualizations :

Contributing

Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated.

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b your-new-branch-name)
  3. Commit your Changes (git commit -m 'Add some changes')
  4. Push to the Branch (git push origin <add-your-branch-name>)
  5. Open a Pull Request

Contact

ETTABAA Hajar - @hajar-ettabaa