From 2de8e616c24e202d1944453397aa4ffba46e9a0f Mon Sep 17 00:00:00 2001 From: Wesley van Lee Date: Tue, 22 Oct 2024 10:25:28 +0200 Subject: [PATCH] Properly add new URI template variables to docs --- docs/settings.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/docs/settings.md b/docs/settings.md index e81a0f3..7054e40 100644 --- a/docs/settings.md +++ b/docs/settings.md @@ -8,12 +8,13 @@ ```python SW_EXPORT_URI = "s3://scrapy-webarchive/" +SW_EXPORT_URI = "s3://scrapy-webarchive/{spider}/" SW_EXPORT_URI = "s3://scrapy-webarchive/{year}/{month}/{day}/{spider}/" ``` This is the output path of the WACZ file. Multiple variables can be added that allow dynamic generation of the output path. -Supported variables: `year`, `month`, `day` and `timestamp`. +Supported variables: `spider`, `year`, `month`, `day` and `timestamp`. ## Downloader middleware and spider middleware