Releases: DataCrawl-AI/datacrawl
Releases · DataCrawl-AI/datacrawl
v0.5.0
v0.4.0-beta
v 0.4.0-beta
v0.3.0: Merge pull request #7 from indrajithi/feature/concurrent-workers
- Set concurrent workers, custom delay and optional verbose
v0.2.0
Update version
v0.1.4.1
Update ci.yml
v0.1.3: Merge pull request #4 from indrajithi/feature/deploy
- Crawl web pages and extract links
- Handle relative and absolute URLs
- Save crawl results to a JSON file