Skip to content

Latest commit

 

History

History
76 lines (55 loc) · 1.34 KB

README_EN.md

File metadata and controls

76 lines (55 loc) · 1.34 KB

51job Recruitment Website Scraping and Visualization

English| 中文

Demonstration⌛

Example address:http://51job.pshxx.cc


  1. Web Display Process Diagram img.png img_1.png

  2. Data Crawling Process Diagram Process Diagram

Introduction📝


  • 🌐 Customizable scraping of job keywords and quantities
  • 📈 Real-time display of recruitment situation on a large screen
  • 🎨 Generating data analysis graphics using ECharts
  • 🐳 Using MySQL for storage to achieve frontend data interaction

Start the Scraping Service⚡


  1. First, download the required packages (I didn't filter the generated packages directly, so there might be some clutter🚨)
pip install -r requirements.txt
  1. Modify the configuration file config.ini and add MySQL, account information, etc.

  2. Run the crawler

python crawler.py

Web Visualization✨

Run the command in the terminal under the project folder


local

python app.py

or

flask run

docker

docker build -t my-python-app . && docker run -d -p 5000:5000 my-python-app