Rendered at 01:17:07 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
faangguyindia 21 hours ago [-]
If you want to access data from websites which prevent it, you gotta use a headless browser with Residential Proxy Network Like Bright Data (formerly Luminati).
nicbou 17 hours ago [-]
Our industry's understanding of consent is terrifying
jeong_jeong 14 hours ago [-]
It’s called hacker news, bro
4lx87 1 days ago [-]
I'm curious, how do you deal with Cloudflare and similar anti-bot systems? Just keep shopping the job around to different proxies?
faangguyindia 9 hours ago [-]
it's fairly simple, you use browser profiles and you visit multiple website like a normal guy using residential proxyy network
and cloudflare cannot detect you this way.
the older your browser profile is, the less often cloudflare bans.
fragmede 14 hours ago [-]
Cloudflare reads this forum. By answering your question here, they burn that workaround. Why would someone do that? (No one bring up Warframe)
1 days ago [-]
fragmede 14 hours ago [-]
have you already incorporated common crawl into your index?
and cloudflare cannot detect you this way.
the older your browser profile is, the less often cloudflare bans.