Skip to content

Latest commit

 

History

History
65 lines (48 loc) · 1.78 KB

README.md

File metadata and controls

65 lines (48 loc) · 1.78 KB

California Fires History DB

Tracking fire data from www.fire.ca.gov/incidents.

This project is inspired by and adapts the work from simonw/ca-fires-history. Instead of using Git scraping, this project stores the data in a SQLite database and uses GitHub artifacts for storage.

Read more...

How It Works

graph TB
    subgraph Railway
        deployment[Datasette]
    end
    subgraph GitHub
        subgraph Actions
            scraper[scrape.py]
        end
        subgraph Artifacts
            db[(fires.db)]
            class db artifacts;
        end
    end
    subgraph CAL FIRE
        api[API]
    end
    subgraph DockerHub
        dockerhub[Docker Hub]
    end
    db --> |1: Download| scraper
    api --> |2: Fetch Data| scraper
    scraper --> |3: Upload| db
    scraper --> |4: Publish to Docker Hub| dockerhub
    dockerhub --> |5: Pull Image and Deploy| deployment
    deployment --> |6: View/Access Data| client[User]
Loading

Usage

Running the Script

To run the script locally and update the database:

python3 scrape.py

Optional: Running Datasette

To view and explore the data using Datasette:

pip install datasette # optional: install Datasette if you haven't already

datasette data/fires.db --metadata data/metadata.json

License

This project is licensed under the MIT License.

Disclaimer

This software is only used for research purposes, users must abide by the relevant laws and regulations of their location, please do not use it for illegal purposes. The user shall bear all the consequences caused by illegal use.