Skip to content
This repository has been archived by the owner on Nov 17, 2022. It is now read-only.

建议增加睡眠功能 #60

Open
dreamer2q opened this issue Apr 26, 2020 · 3 comments
Open

建议增加睡眠功能 #60

dreamer2q opened this issue Apr 26, 2020 · 3 comments

Comments

@dreamer2q
Copy link

多线程爬经常被ban
此外,ssl返回错误的话,脚本就会崩溃,
脚本崩溃就得重爬,
重爬有不可能一次性爬完,
又得循环上述步骤

建议加入单线程,每爬一个连接休息n秒钟的功能

@dreamer2q
Copy link
Author

如果电子书内容带有 HTML 相关的< >标签,会导致html标签错乱,进而导致最后生成的pdf排版出现问题。

@fuergaosi233
Copy link
Owner

可以贴一下你要跑的 URL 么方便我重现问题修一下。

@dreamer2q
Copy link
Author

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants