Skip to content

@crawlab-team Crawlab Team

Change the repository type filter

All

    Repositories list

    49 repositories

    • crawlab

      Public
      Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
      godockerplatformcrawlerspiderweb-crawlerscrapywebcrawlerscrapyd-uiwebspider
      Go
      •
      BSD 3-Clause "New" or "Revised" License
      •1.8k•11k•106•0•Updated Dec 25, 2024Dec 25, 2024

    • crawlab-ui

      Public
      🎉 A Vue.js 3.0 UI Library made by Crawlab team
      vueelement-uivue3crawlab
      Vue
      •
      BSD 3-Clause "New" or "Revised" License
      •17k•20•0•0•Updated Dec 25, 2024Dec 25, 2024

    • e2e-tests

      Public
      TypeScript
      •0•1•0•0•Updated Dec 20, 2024Dec 20, 2024

    • crawlab-test-report

      Public
      0•0•0•0•Updated Dec 19, 2024Dec 19, 2024

    • crawlab-python-sdk

      Public
      Python SDK for Crawlab
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1•0•0•0•Updated Dec 18, 2024Dec 18, 2024

    • crawlab-docs

      Public
      Documentation for Crawlab
      documentationgitbook-clicrawlab
      JavaScript
      •55•39•1•2•Updated Jul 18, 2024Jul 18, 2024

    • crawlab-core

      Public
      Backend core modules for Crawlab
      Go
      •
      Apache License 2.0
      •54•50•0•0•Updated Jun 14, 2024Jun 14, 2024

    • crawlab-grpc

      Public
      gRPC for Crawlab
      Shell
      •
      BSD 3-Clause "New" or "Revised" License
      •12•4•0•0•Updated Jun 14, 2024Jun 14, 2024

    • docker-base-images

      Public
      Shell
      •
      BSD 3-Clause "New" or "Revised" License
      •6•2•0•0•Updated Jun 11, 2024Jun 11, 2024

    • crawlab-demo

      Public
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •6•2•0•0•Updated Jun 4, 2024Jun 4, 2024

    • crawlab-ai-sdk

      Public
      SDK for Crawlab AI
      Python
      •
      MIT License
      •3•7•2•0•Updated Jun 4, 2024Jun 4, 2024

    • crawlab-sdk

      Public
      SDK for Crawlab, including SDK for different programming languages such as Python, Node.js and Java, and a CLI Tool written in Python.
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •51•55•2•5•Updated Jun 3, 2024Jun 3, 2024

    • crawlab-fs

      Public
      Backend file system module for Crawlab
      Go
      •
      BSD 3-Clause "New" or "Revised" License
      •12•4•0•0•Updated Mar 29, 2024Mar 29, 2024

    • goseaweedfs

      Public
      A complete Golang client for SeaweedFS
      Go
      •
      Apache License 2.0
      •50•4•0•0•Updated Mar 29, 2024Mar 29, 2024

    • scrapy-ai

      Public
      AI-powered scrapy plugin
      Python
      •
      MIT License
      •0•1•0•0•Updated Feb 7, 2024Feb 7, 2024

    • crawlab-vcs

      Public
      Version Control System (VCS) for Crawlab
      Go
      •
      BSD 3-Clause "New" or "Revised" License
      •11•4•0•1•Updated Aug 8, 2023Aug 8, 2023

    • webspot

      Public
      An intelligent web service to automatically detect web content and extract information from it.
      crawlerwebspidercrawlab
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •12•85•1•0•Updated Jul 13, 2023Jul 13, 2023

    • crawlab-next

      Public
      C#
      •
      Apache License 2.0
      •1•0•0•0•Updated May 31, 2023May 31, 2023

    • html-to-json-enhanced

      Public
      Convert HTML to JSON. Can also (intelligently) convert HTML tables to JSON (using table headers (if available) as keys in the resulting JSON).
      HTML
      •
      MIT License
      •8•4•0•0•Updated Apr 1, 2023Apr 1, 2023

    • artipub

      Public
      Article publishing platform that automatically distributes your articles to various media channels
      nodejstypescriptarticlemediaarticle-publisherdockermongodbcsdnsegmentfault
      TypeScript
      •
      BSD 3-Clause "New" or "Revised" License
      •529•3.1k•29•11•Updated Mar 5, 2023Mar 5, 2023

    • crawlab-lite

      Public
      Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
      platformcrawlerspiderweb-crawlerscrapyscrapydscrapy-uiscrapyd-uicrawling-taskscrawlab
      Vue
      •
      BSD 3-Clause "New" or "Revised" License
      •75•224•1•8•Updated Feb 9, 2023Feb 9, 2023

    • crawlab-db

      Public
      Backend database module for Crawlab
      Go
      •
      BSD 3-Clause "New" or "Revised" License
      •16•4•1•0•Updated Dec 26, 2022Dec 26, 2022

    • vue3-dropzone

      Public
      HTML5 file drag-drop zone with vue3
      TypeScript
      •
      MIT License
      •16•1•0•0•Updated Dec 21, 2022Dec 21, 2022

    • vuepress-plugin-mermaidjs

      Public
      Vuepress plugin for mermaid.js diagrams
      TypeScript
      •22•0•0•0•Updated Oct 23, 2022Oct 23, 2022

    • examples

      Public
      Python
      •
      MIT License
      •8•3•0•0•Updated Oct 19, 2022Oct 19, 2022

    • tada

      Public
      BSD 3-Clause "New" or "Revised" License
      •0•0•0•0•Updated Oct 8, 2022Oct 8, 2022

    • template-parser

      Public
      Go
      •
      MIT License
      •7•4•0•0•Updated Oct 6, 2022Oct 6, 2022

    • public-plugins

      Public
      Public plugins repo for Crawlab
      Go
      •
      BSD 3-Clause "New" or "Revised" License
      •6•4•1•0•Updated Oct 6, 2022Oct 6, 2022

    • crawlab-log

      Public
      Log module for Crawlab
      Go
      •
      BSD 3-Clause "New" or "Revised" License
      •9•1•0•0•Updated Oct 1, 2022Oct 1, 2022

    • traffic

      Public
      BSD 3-Clause "New" or "Revised" License
      •0•0•0•0•Updated Jul 2, 2022Jul 2, 2022