Free Republic
Browse · Search
General/Chat
Topics · Post Article

This seems hard for me to believe, given how shallow today's Search Engines are. 15 years ago, you could really dig down, but now it seems like all Search Engines just show a few results, and it's hard to dig down deeper than the most common things. And remember when they used to have a cache? Where did that go?


If anyone knows differently please let me know. But Search Engines today seem to have about 40% of the value they used to have. Does anyone know of one that actually allows you to search?

1 posted on 09/01/2025 1:41:35 PM PDT by nickcarraway
[ Post Reply | Private Reply | View Replies ]


To: nickcarraway
Free search engines are a thing of the past.

You are going to have to pay for service now.

2 posted on 09/01/2025 1:45:52 PM PDT by Harmless Teddy Bear ( Not my circus. Not my monkeys. But I can pick out the clowns at 100 yards.)
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway

https://en.wikipedia.org/wiki/Dead_Internet_theory


3 posted on 09/01/2025 1:47:34 PM PDT by ClearCase_guy (Society has no reward for following the rules any more)
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway

Oh absolutely believe it. No different than a DDoS attack... In fact a friend is battling it right now... It is getting hammered so fast and so much the security will not let it stay up for safety reasons... It is useless because of the massive amount of hits all at once...


4 posted on 09/01/2025 1:48:03 PM PDT by Openurmind (AI - An Illusion for Aptitude Intrusion to Alter Intellect. )
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway

The bots will scream at each other while we watch cat videos. The internet will ultimately consume itself and we will be done with it. I’ll miss y’all, but I think it’s doing more harm than good.


6 posted on 09/01/2025 1:52:06 PM PDT by bk1000 (Banned from Breitbart)
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway

A true AI, “hungry for any and all content” would quickly ferret out the Globull Climate Hoax.

Whatever they are labeling AI today, it is programmed, and the programmer(s) are human.

HIGHLY recommend: The Myth of Artificial Intelligence by someone on the ground floor, Erik J. Larson


8 posted on 09/01/2025 2:00:25 PM PDT by Ronaldus Magnus III (Do, or do not, there is no try )
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway

“ Anyone who runs a website, though, knows there’s a huge, honking difference between the old-style crawlers and today’s AI crawlers. The new ones are site killers.”
************************************

Kind of like incessant ZEEPER posters.


10 posted on 09/01/2025 2:04:06 PM PDT by House Atreides (I’m now ULTRA-MAGA-PRO-MA)
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway

Fine. I hope AI likes clickbait.


11 posted on 09/01/2025 2:06:28 PM PDT by Fledermaus ("It turns out all we really needed was a new President!")
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway

Next up - Bot Blockers. “Nive website you got here; be a shame if anything happened to it.”


15 posted on 09/01/2025 2:15:08 PM PDT by Bernard (Issue an annual budget. And Issue a federal government balance sheet. Let's see what we got.)
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway
80% of all AI bot traffic comes from AI data fetcher bots.

Gonna need a biologist to figure out all this.

16 posted on 09/01/2025 2:18:27 PM PDT by Libloather (Why do climate change hoax deniers live in mansions on the beach?)
[ Post Reply | Private Reply | To 1 | View Replies ]

To: All

AND they are making it miserable for us real people too.

I’d say that 20% of the sites I try to visit, (and increasing daily) for research, entertainment or commerce have some sort of ‘bot’ filter. that want me to ‘verify that I am human’, turn off my VPN, lower my ‘shields’, and let THEM run THEIR spybots on my computer.

Unless it is something really important, I just move on to the next site that offers what I’m looking for without the verification page.

I’d estimate that the ‘prove you are human’ website sentries have cost various online sellers a thousand dollars of my money not being spent with them, and who knows how many dollars of ad money the information / entertainment websites have lost because I didn’t click through all their nonsense.

And my tin-hated alter ego says this is just one giant step along the path to being required to have a Digital ID and a social credit score to use the internet at all, and not really that AI is costing website owners millions of dollars.


18 posted on 09/01/2025 2:46:19 PM PDT by LegendHasIt
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway

I don’t get what the bots are looking for. What “content”? What of value are they “raiding”?


29 posted on 09/01/2025 3:23:36 PM PDT by TalBlack (Their god is government. Prepare for a religious war.https://freerepublic.com/perl/post?id=4322961%2)
[ Post Reply | Private Reply | To 1 | View Replies ]

To: nickcarraway

I am the IT guy for some large websites. One gets over 120 million monthly pageviews. It gets hammered by AI-related bots, but we’ve got good caching, and know how to deal with bots and such.

AI web crawlers can be a problem for some sites, but not for those with quality hosting.


36 posted on 09/01/2025 4:35:43 PM PDT by Theo (FReeping since 1997 ... drain the swamp.)
[ Post Reply | Private Reply | To 1 | View Replies ]

Free Republic
Browse · Search
General/Chat
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson