Salamander

  • 426 Posts
  • 1.35K Comments
Joined 3 years ago
cake
Cake day: December 19th, 2021

help-circle





  • Thank you. There was a different error that should have been fixed yesterday (a “too many requests” reply from the object storage provider). But this error is different, and I am not sure yet why it happens. I will change some settings that could have an effect. Please let me know if it happens again!



  • SalamanderMAtoScience MemesTell me Y
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 months ago

    Good news! Just got a reply from them and they have increased the connection limit. They did not specify what the new number is, but hopefully it is high enough to not be an issue for the foreseeable future.

    So, if you do run into other similar reports after this comment I would appreciate it if you tag me again.


  • SalamanderMAtoScience MemesTell me Y
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    Thanks!

    Cost is not the bottleneck in this case… The problem is that I am rather ignorant about the options and their benefits/limitations. Moving the images the first time was painfully slow because of those same rate limits, and I expect the next migration to be the same, so I want to make a better choice next time and would rather find a solution with the current provider 😅




  • If I am not given the ability to improve the rate limits soon I will need to find a different object storage provider. The migration will bring down the instance’s images for several days so I am trying to avoid that…

    If anyone knows of a good and reliable object storage provider with better limits, I would appreciate the recommendations.


  • SalamanderMAtoScience MemesCats are liars.
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 months ago

    This is the current status:

    • The instance is serving the images via object storage. Specifically, I am making use of Contabo to save and serve the images.

    • I now know that the default limits are 250 requests / second and 80 Mbit/s: https://help.contabo.com/en/support/solutions/articles/103000275478-what-limits-are-there-on-object-storage-

    • It appears to me like when the requests are exceeded, the “Too many requests” error is triggered and it takes a few seconds before the requests are accepted again. This can happen if few users access the front page at once as this will fetch all of the thumbnails and icons on the page.

    • I have been in touch with Contabo’s customer support via e-mail. But they mis-understood my original e-mails and thought I was speaking about increasing the maximum number of images that can be stored (3 million by default). I have clarified that I want to increase the rate limit and have been waiting for their response for a few days now.

    • The other solution would be to move the images to a different object storage provider. The migration is also limited to the 250 requests/s and 80 Mbit/s, so it will require turning off the images for 4 - 7 days while all the images are moved… Since I am not familiar with the policies of other object storage providers I would also need to do research to avoid falling into the same trap.

    So, I am hoping that Contabo’s support will get back to me soon and allow me to increase the rate limits, as this would be the most straight forward approach.






  • SalamanderMAtoScience MemesOld AF
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 months ago

    I have been reaching out to the object storage provider to see if I can increase the rate limits… Unfortunately I might need to change to a different provider to overcome this. Since the migration takes several days, especially so because of those same rate limits, I would rather avoid this…






  • SalamanderMAtoScience MemesCats are liars.
    link
    fedilink
    English
    arrow-up
    7
    ·
    2 months ago

    This error is a rate limit from the object storage provider. I did not know of this limit when I chose them, and I still have not found a way to change the limit. I will send them an e-mail. If the limit can’t be increased, one option is to pick another object storage provider, but the migration takes days.