I made a video in 1995 of a BBN proposal on how to pull information out of vast amounts of data.
BBN PLUM - Probabilistic Language Understanding Model - 1996
That’s great for research by topic. I’m wondering about tracking an individual.
>>My question is what kind of software do they use to *search* it?
I should have added your question to my video post. Apologies.
Data mining is performed by software developed by Palantir:
These systems are almost unbelievably efficient. Data mining is the fastest growing and most profitable sector in the industry. We long ago passed the point where aggregated sets surpassed human analysis. These systems can process Petabytes of materials, making connections that would take years to track down using traditional methodology.