[Angelino97]

Websites are dropping like flies because they just cannot handle the bandwidth load.

Is this a problem for low-ranked websites?

Don't most AIs spider only higher ranked sites, like Wikipedia?

Whenever I ask Grok a question, it seems Grok only checks a few sites. A few dozen for more esoteric questions. But always, only the popular, higher ranked sites.

[mairdie]

>>Don’t most AIs spider only higher ranked sites, like Wikipedia?

I’ve had AI return information from my personal websites many times.

I have a log that shows who is touching which pages of my two sites (about 1600 pages in each). I watch spiders constantly walking my sites, though I’ve never back searched in the last few years when AI was more prevalent.