A crawler for lots of articles
MariaDB
mysql -uroot -p -e 'create database article_crawler;'
Set your config.js
module.exports = {
database: {
host: '127.0.0.1',
port: 3306,
user: 'root',
pass: '123456',
name: 'article_crawler'
}
}
It's not finish Task Manager Module, so just run plugin!
Crawl xz.aliyun.com: node plugins/xz.aliyun.com.js
yarn run web
// or
node preview.js
- 先知 xz.aliyun.com