- 350mph true cruise airspeed for the stock aircraft, so I suspect you had a bit of a tailwind there.
- 0.3-1m.
- Ovh provides ddos protection without that nonsense, for free. Aws does it too, for a fee.
- Looking into this more, it does indeed seem to be a cloudflare problem. It looks like cloudflare made a significant error in their bot fingerprinting, and Perplexity wasn't actually bypassing robots.txt.
https://www.perplexity.ai/hub/blog/agents-or-bots-making-sen...
To be honest I find cloudflare a much more scammy company than Perplexity. I had a DDoS attack a few years ago which originated from their network, and they had zero interest in it.
- But is there any actual evidence that any major AI bots are bypassing robots.txt? It looked as if Perplexity was doing this, but after looking into it further it seems that likely isn't the case. Quite often people believe single source news stories without doing any due diligence or fact checking.
- Actually, it looks like all the major ones do honour robots.txt including perplexity. They seemingly get around it using google serps, so theyre not actually crawling or hammering the site servers (or even cloudflare).
https://www.ailawandpolicy.com/2025/10/anti-circumvention-re...
- What security issue is actually being solved here though?
- I was referring to the community wiki.
- I was referring to legitimate ones, which you can easily block. Obviously there are scammy ones as well, and yes it is an issue, but for most sites I would say the cloudflare cure is worse than the problem it's trying to cure.
- Yes, I was referring to legitimate companies, and Perplexity doesn't seem to be one of those.
- The legitimate ones do, which is what I was referring to. Obviously there are bastard ones as well.
- There shouldn't be any noticeable hit on your cpu from bots from a site like that. Are you sure it's not a DDoS?
Obviously it depends on the bot, and you can't block the scammy ones. I was really just referring to the major legitimate companies (which might not include Perplexity).
- Tell me you make incorrect assumptions without specifically saying so. (Yes, you're incorrect).
- I have been managing production commercial web servers for 28 years.
Yes, there are various bots, and some of the large US companies such as Perplexity do indeed seem to be ignoring robots.txt.
Is that a problem? It's certainly not a problem with cpu or network bandwidth (it's very minimal). Yes, it may be an issue if you are concerned with scraping (which I'm not).
Cloudflare's "solution" is a much bigger problem that affects me multiple times daily (as a user of sites that use it), and those sites don't seem to need protection against scraping.
- >You call it extortion of the AI companies, but isn’t stealing/crawling/hammering a site to scrape their content to resell just as nefarious?
You can easily block ChatGPT and most other AI scrapers if you want:
- I've noticed that in recent months, even apart from these outages, cloudflare has been contributing to a general degradation and shittification of the internet. I'm seeing a lot more "prove you're human", "checking to make sure you're human", and there is normally at the very least a delay of a few seconds before the site loads.
I don't think this is really helping the site owners. I suspect it's mainly about AI extortion:
- According to a Pew study, the majority of Americans use AI on a regular basis:
https://www.pewresearch.org/science/2025/09/17/ai-in-america...
- Youll struggle to get the rda from diet alone unless you eat daily fish.
https://ods.od.nih.gov/factsheets/VitaminD-HealthProfessiona...
- Unlike us, the virus will replicate much more quickly in their bodies. It wont kill them, but will likely make the infection last longer.
Havent had a fever in many years, since taking flu and covid shots each year.
Although I think the more interesting question is whether sunbed use increases or decreases overall mortality. The only study I can find is Lindqvist's:
https://onlinelibrary.wiley.com/doi/pdf/10.1111/joim.12251?g...
Overall, sunbed use reduced the all-cause mortality by a ratio of 0.77 or 0.87 depending on the model used. It increased the risk of developing MM, and the risk of dying from MM, although all-cause mortality was not increased even in patients diagnosed with MM. (This seems to be because there is a very low overall risk of MM mortality, but UV light exposure seems to provide a greater overall health benefit than the small risk of increased MM risk).