Skip to content

Python based web scrapper for fcainfoweb.nic.in/reports to extract wholesale and retail price reports

License

Notifications You must be signed in to change notification settings

Gray-Rice/fcainfoweb-scrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

fcainfoweb-scrapper

Python based web scrapper for fcainfoweb.nic.in/reports/Report_Menu_web.aspx to extract wholesale and retail price reports from user defined year till present day

Running the program:

1. Install Dependencies:

Assuming python is installed and configured properly

  1. Selenium:
    pip install selenium
    Or alternatively use your desired package manager

  2. Webdriver:
    The script uses mozilla's GeckoDriver by default, make sure it is installed and configured properly.
    Those who wish to utilise a different driver make appropriate changes to scrapper.py.

2. Running:

Run the script with python scrapper.py -y year
To Scrape wholesale data an optional flag -w is required
python scrapper.py -w -y year

Example:
To get retail data from 01/01/2024
python scrapper.py -y 2024
Wholesale date from same date:
python scrapper.py -w -y 2024

Note: default date starts from 1st of january for all years

About

Python based web scrapper for fcainfoweb.nic.in/reports to extract wholesale and retail price reports

Topics

Resources

License

Stars

Watchers

Forks

Languages