Skip to content

Commit

Permalink
docs: mention quantization example for env variable
Browse files Browse the repository at this point in the history
  • Loading branch information
thiswillbeyourgithub committed Sep 14, 2024
1 parent 88a61dd commit 9875281
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/faster_whisper_server/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -170,7 +170,7 @@ class Config(BaseSettings):
Pydantic will automatically handle mapping uppercased environment variables to the corresponding fields.
To populate nested, the environment should be prefixed with the nested field name and an underscore. For example,
the environment variable `LOG_LEVEL` will be mapped to `log_level`, `WHISPER__MODEL`(note the double underscore) to `whisper.model`, etc.
the environment variable `LOG_LEVEL` will be mapped to `log_level`, `WHISPER__MODEL`(note the double underscore) to `whisper.model`, to set quantization to int8, use `WHISPER__COMPUTE_TYPE=int8`, etc.
""" # noqa: E501

model_config = SettingsConfigDict(env_nested_delimiter="__")
Expand Down

0 comments on commit 9875281

Please sign in to comment.