Preferences


> While Cloudflare blocks almost all AI crawlers, there’s one particular bot it cannot block without affecting its customers’ online presence — Google. The search giant combined its search and AI crawler into one, meaning users who opt out of Google’s AI crawler won't be indexed in Google search results. “You can’t opt out of one without opting out of both, which is a real challenge — it’s crazy,” Prince continued. “It shouldn’t be that you can use your monopoly position of yesterday in order to leverage and have a monopoly position in the market of tomorrow.”

Of course Google would do that.

This item has no comments currently.

Keyboard Shortcuts

Story Lists

j
Next story
k
Previous story
Shift+j
Last story
Shift+k
First story
o Enter
Go to story URL
c
Go to comments
u
Go to author

Navigation

Shift+t
Go to top stories
Shift+n
Go to new stories
Shift+b
Go to best stories
Shift+a
Go to Ask HN
Shift+s
Go to Show HN

Miscellaneous

?
Show this modal