• 0 Posts
  • 6 Comments
Joined 1 year ago
cake
Cake day: July 5th, 2023

help-circle



  • Rate limiting only goes so far. 10 requests for a 1 second operation is the same thing as 1 request for a 10 second operation. Any CDN, like CloudFlare, can’t do too much about web requests that are super taxing on the database.

    The bot nets that are doing this can be worse than a hydra. If you block one bot, several more pop up to take over where the other left off. Even worse, the requests that the bots are making are legitimate. If you start throttling the specific requests that are too taxing, you are likely going to cause issues for legitimate users that need the same data.

    Additionally, the number of NAT’ed egress IP addresses are much higher than you might think. Blocking just one IP address could mean that you are blocking thousands of users behind that address.

    Sometimes, the best option is to absorb the traffic and ensure that your application is running extremely efficiently.

    This is a complex problem, for sure.