Free Republic
Browse · Search
General/Chat
Topics · Post Article

To: nickcarraway

I am the IT guy for some large websites. One gets over 120 million monthly pageviews. It gets hammered by AI-related bots, but we’ve got good caching, and know how to deal with bots and such.

AI web crawlers can be a problem for some sites, but not for those with quality hosting.


36 posted on 09/01/2025 4:35:43 PM PDT by Theo (FReeping since 1997 ... drain the swamp.)
[ Post Reply | Private Reply | To 1 | View Replies ]


To: Theo
Quality comes at a price.

So the big established guys are protected and the little and medium sized guys get hammered.

Now just who would that benefit?

37 posted on 09/01/2025 5:17:33 PM PDT by Harmless Teddy Bear ( Not my circus. Not my monkeys. But I can pick out the clowns at 100 yards.)
[ Post Reply | Private Reply | To 36 | View Replies ]

Free Republic
Browse · Search
General/Chat
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson