Skip to content

Latest commit

 

History

History
52 lines (36 loc) · 1.92 KB

README.md

File metadata and controls

52 lines (36 loc) · 1.92 KB

gs-scraper

The point of this little project is to build something where I can search across multiple classifieds and garage/estate sale sites for the thing I am looking to buy all at once (usually retro video games).

Prerequisites

  • mongodb installed and running
  • node
  • npm

Project setup

npm i

Compiles and hot-reloads for development in electron window

npm start

Compiles and minifies for production

npm run build

Lints and fixes files

npm run lint

Notes

  • some of the salesServices are really similar. I thought about making 1 method to replace a few of them and calling it with different arguments, but I like the sepration of concerns that exists if any sort of changes were to happen to a particular source so I'm leaving it. Same goes for the backend services.

Future Plans

  • clean it up; lots of loose ends
  • better utilize scss variables for consistency
  • maybe some nice fonts?
  • make hidden only show hidden for current data set. Then add a 'Show All' button to show all hidden for when I want to do some cleanup.
  • add 'cleanup old' button to hidden to delete hidden results over a certain age
  • add loading animation back to search
  • look for any gaps in error handling and fix em
  • add more garage sale search sites (if I find anymore that seem useful)
  • make it look good
  • possibly make an electron app (can use indexDB or jsonStorage instead of mongo) or vuido app (would just stand up DigitalOcean droplet to handle backend)? Either way I want a way to use this that doesn't require me to open a terminal and run npm start everytime I want to use it. If I host the backend on a DO droplet I should add security so random folks can't abuse my API.

I was going to take this a lot further originally, but some of the ideas I came up with seemed better suited for a website/business idea I had which I will be prusuing in a private repo after this is "finished enough".