Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase slice size? #76

Closed
arnili opened this issue Dec 7, 2019 · 7 comments
Closed

Increase slice size? #76

arnili opened this issue Dec 7, 2019 · 7 comments
Labels
enhancement New feature or request speed-issue Reported speed or performance issue

Comments

@arnili
Copy link

arnili commented Dec 7, 2019

Lancache slices even linear client downloads into 1MB chunks. This is a good thing because it prevents downloading of unneeded blocks, thus saving bandwidth.

Multi 100Mbit/s links are the norm today and nginx's http1.0 (non-pipelined, non-keepalived) requests to backend servers seem to become the bottleneck at around 120 to 180Mbit/s when a single client issues a single, linear and uncached request for a large file.

What are your thoughts on increasing this to maybe 10MB by default or making this configurable?
(I'm aware the cache needs to be purged after a change).

Thank you.

@VibroAxe
Copy link
Member

VibroAxe commented Dec 8, 2019

Id not be against considering adding a configurable environment variable. @Lepidopterist @mintopia thoughts

@VibroAxe
Copy link
Member

VibroAxe commented Dec 8, 2019

Having thought on this for a bit longer, if we did this I'd like to find a way to sanity check cache files / a saved config file which prevents a user accidentally invalidating an entire cache

Something like: save the slice size into a file in /cache, read back on start up. If file doesn't match, or a non default has been set with no previous slice file (and cache data existing) then the image will stop until removed/overridden or similar

@unspec unspec added enhancement New feature or request speed-issue Reported speed or performance issue labels Feb 22, 2020
@unspec
Copy link
Member

unspec commented Feb 24, 2020

Hi @arnili

Changing the slice size has been added in the latest version.

See http://lancache.net/docs/advanced/tuning-cache/#tweaking-slice-size for information on how to make use of this - and let us know if you think the documentation is missing anything.

Please note that it does come with some potential downsides (discussed in the above link) and will invalidate any already cached data on your cache if you change the value.

To tidy up the issues, if you choose to test this please post any feedback on this issue: lancachenet/generic#100

Thanks,

@unspec unspec closed this as completed Feb 24, 2020
@arnili
Copy link
Author

arnili commented Feb 24, 2020

Thanks alot (y)

@hyacin75
Copy link

and let us know if you think the documentation is missing anything.

Hi, yeah, not sure if the documentation has changed since this was posted - but it's missing how to do it, like, entirely. I'm curious specifically for the monolithic container image - as I've read in a few places now that that is supported - but I can't find anywhere how to actually do it. I'm getting about 20-33% of the d/l speed I get sans lancache on my Xbox while using lancache :-(

@DuzAwe
Copy link

DuzAwe commented Feb 5, 2023

@hyacin75
Copy link

hyacin75 commented Feb 6, 2023

Better late than never, but, yeah, I stopped running this like two years ago since it was actually making my performance worse and I wasn't getting any help to solve that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request speed-issue Reported speed or performance issue
Projects
None yet
Development

No branches or pull requests

5 participants