Python based web scrapper for fcainfoweb.nic.in/reports/Report_Menu_web.aspx to extract wholesale and retail price reports from user defined year till present day
Assuming python is installed and configured properly
-
Selenium:
pip install selenium
Or alternatively use your desired package manager -
Webdriver:
The script uses mozilla's GeckoDriver by default, make sure it is installed and configured properly.
Those who wish to utilise a different driver make appropriate changes toscrapper.py
.
Run the script with
python scrapper.py -y year
To Scrape wholesale data an optional flag -w
is required
python scrapper.py -w -y year
Example:
To get retail data from 01/01/2024
python scrapper.py -y 2024
Wholesale date from same date:
python scrapper.py -w -y 2024
Note: default date starts from 1st of january for all years