After metas crawler sent 11 million requests. Claude has now topped the charts with 12m in the last 15 days alone. Meta is also completely ignoring robots given the 700k requests theyve sent regardless.

Here's the IP addresses hitting the hardest. 216.73.216.x is anthropics main aws crawler. Some interesting crawlers. Wtf is ripe? The 66.249.68.x seem to be some internal google one not related to search or maybe just some gcp based crawler.

Anyone else seeing this? the vercel bill is completely fucked. first week in were at 500+ spend. 400+ is from function duration on programmatic SEO endpoints. The industries response has been to lick the boot of cloud providers as if they arent the ones funding this circular economy pyramid scheme bs. Throwing up some cloudflare WAF to block other computers from communicating is insane. yes we know vps is cheaper, not the point.