Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

_update_files_list stalls uploading on any bucket with > 1k files #31

Open
kaivi opened this issue Feb 14, 2019 · 1 comment
Open

_update_files_list stalls uploading on any bucket with > 1k files #31

kaivi opened this issue Feb 14, 2019 · 1 comment

Comments

@kaivi
Copy link

kaivi commented Feb 14, 2019

What is the point of retrieving a complete file list right after a successful upload? It is this line here.

With a bucket of 500k files, the lib goes through all of them 1k at a time:

image

@WardPearce
Copy link

Hey, might be worth checking out my backblaze b2 wrapper.
I don't believe it has this issue.

https://pypi.org/project/backblaze/
https://backblaze.readthedocs.io/en/latest/index.html
https://github.com/WardPearce/backblaze

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants