Free Republic
Browse · Search
General/Chat
Topics · Post Article

To: garjog

Not I. I just work in computer security and research and development and have had meetings with the make of the software that does exactly this kind of thing, and he US government is one of their biggest customers. Put and and two together, and its easy. Its software used by a lot of companies to monitor pricing changes on e-retailing sites, and then adjust their own prices accordingly. Its also used as a data aggregation tool for software that runs on the web but doesn’t have an API to access its data directly. There are many tools that do this, but the one from the company I am working with is particularly awesome. Do a search on “web scraping” and you will find hundreds of links to software that does this and eventually come across the company that supplies the software to the government. I however will not directly say who they are, as they are an honest company that just happens to be capitalizing off the governments need for spying.


19 posted on 03/16/2012 11:02:29 PM PDT by lefty-lie-spy (Stay metal. For the Horde \m/("_")\m/ - via iPhone from Tokyo.)
[ Post Reply | Private Reply | To 14 | View Replies ]


To: lefty-lie-spy
"Not I. I just work in computer security and research and development"

Sure, wink, wink. That's your cover. "Here I am in Japan just working for a computer security and research and development company... nothing to see here..."

But, then you probably go hide out here:


30 posted on 03/16/2012 11:17:38 PM PDT by garjog
[ Post Reply | Private Reply | To 19 | View Replies ]

To: lefty-lie-spy

“Do a search on “web scraping” and you will find hundreds of links to software”

Thanks. This is insightful.

I didn’t realize the technology is so common. The Blaze article linked above makes it sound like there is a super computer that listens into everything around the world.


32 posted on 03/16/2012 11:19:37 PM PDT by garjog
[ Post Reply | Private Reply | To 19 | View Replies ]

To: lefty-lie-spy

are you saying it scrapes all internet sites or just the ones you tell it to or the ones that are indexed by the major search engines?


59 posted on 03/17/2012 1:00:01 AM PDT by superfries
[ Post Reply | Private Reply | To 19 | View Replies ]

To: lefty-lie-spy

are you saying it scrapes all internet sites or just the ones you tell it to or the ones that are indexed by the major search engines?


60 posted on 03/17/2012 1:03:19 AM PDT by superfries
[ Post Reply | Private Reply | To 19 | View Replies ]

Free Republic
Browse · Search
General/Chat
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson