Interactive dashboard project to visualize the impact of community's mobility to daily new COVID-19 cases
by leveraging the data from MOH Malaysia, Google, Apple, Waze and TonTon.
Tableau dashboard: https://public.tableau.com/views/COVID-19MobilityDashboard/MobilityTrends
Daily auto-updating Data Studio dashboard: https://datastudio.google.com/reporting/54616e0e-19c9-4097-bca7-22d2fa9e7541
This project aims to gain an insight into the trends of mobility within Malaysian community, and its effects on the current emergence of novel COVID-19 pandemic. The generous dataset provided by various platform, eg. MOH Malaysia, Google, Apple, Waze and TonTon, allow the leverage of big dataset of Malaysia in establishing assocation between Malaysian's mobility trends with the daily COVID-19 cases.
With the data scraped daily by ActiveConclusion on international level, and data published daily by MOH Malaysia on their official github repo, data wrangling is done on a daily basis to yield datasets confined to Malaysia with mergeable columns on "date" and "state" of Malaysia. Details of data and script are as in the following section.
- Python script to pull and filter all the data from sources: script-compiled.py
Description of each python lines were included in the script as comment-out.
Data processing scripts for respective dataset are also available in Jupyter notebook format to generate selected dataset of your choice. - YAML script to set-up GitHub Actions workflow for daily data updates: .github/workflows/data-updater.yml
- Bash script to automate the regular data updates using linux machine: data-updater.sh
- MOH Malaysia COVID-19 Daily Cases: moh-cases.csv
- MOH Malaysia COVID-19 Daily Tests: moh-tests.csv
- MOH Malaysia COVID-19 Daily Deaths: moh-deaths.csv
- MOH Malaysia State Population Dataset: static-population.csv
- MOH Malaysia MySejahtera Check-Ins Dataset: mysjh-checkins.csv
- Google Mobility Dataset (Malaysia): google-mobility-data-malaysia.csv
- Apple Mobility Dataset (Malaysia): apple-mobility-data-malaysia.csv
- Waze Traffic Dataset (various cities in Malaysia): waze-mobility-data-malaysia.csv
- TomTom Traffic Dataset (Kuala Lumpur): tomtom-mobility-data-malaysia.csv
All columns should be self-explanatory. Please check the respective sources below for more information.
- Mobility data scraped from Google, Apple, Waze and TomTom by ActiveConclusion
- Daily new NOVID-19 cases and MySejahtera Check-Ins data by MOH Malaysia
Also, checkout the terms and conditions if you wish to download, copy or use the data by MOH Malaysia, Google, Apple, Waze and TomTom.
Any reviews, suggestions and collaborations are warmly welcomed through pull requests, issues or direct email (check dashboard link above).