#Novel MetaSearchEngine
Current Version: V0.1
Novel MetaSearchEngine is a service that grep novels from websites' search Engine, store them in MySQL database and present the novel with its sources to user. Beside, it comes with send by email service wich can be used for SendToKindle service provided by Amazon.
It can be used to check the update of novels periodically
Wtitten by Python 2.7 and using lxml,urllib2,pinyin,smtplib
##TODOs
Finish Crawler
Fix encoding issue
Update main program by add read settings
Update main program by add send to email
Update main program by add update settings
##Setup Install relys by pip:
pip install pinyin
##Usage: This version is running on CentOS 7 without any program.
Note: For stable version(current master branch) implements a program that gathering novel charpters from an index page of a novel in specific websites. The beta version(MySql branch) comes with MySQL database support.
For each time program runs, it will check and update following settings. All related settings are stored in file.
Store the novel relate content in side of setting file by follow the format:
$BookName:[BookName]
!Website:[Front page Link]
!IndexLink:[Index Page Link]
!StartCharNum:[Char number that you want to start grep]
$EndingCharNum:[Char number that you want to end grep]
=================
For email settings, please store the related content inside of mail file with following format:
$Sender:[Sender email]
!Receiver:[Receiver Email]
!Subject:[Subject of the email]
!Website:[SMTP server address of the mail service provider]
$PassWD:[Passwd that decode to base64]
=================
##Setup on *inx like platform: we shall using crontab command to run the program periodically by
crontab -e
Add a new service by following format
[min] [hr] [day of month] [month] [day of week] [execute method] [executable file name] [options]
Here is an example:
0 20,8 * * * /usr/bin/python /path/novel/processCharpter.py >>/path/novel/Novel`date +\%Y\%m\%d_\%H:\%M`.log 2>&1