Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

AVG disguises fake traffic as IE6
The Register ^ | 6/26/08 | Cade Metz

Posted on 06/27/2008 12:05:44 PM PDT by LibWhacker

Exclusive AVG has rejiggered the fake traffic it's spewing across the internet, causing new headaches for the world's webmasters.

In late February, AVG paired its updated anti-virus engine with a real-time malware scanner that vets search engine results before you click on them. If you search Google, for instance, this LinkScanner automatically visits each address that turns up on Google's results page.

According to the company, more than 20 million people have downloaded the new AVG 8, and this has caused a huge up-tick in traffic on sites across the web, including The Register. Because the scanner attempts to disguise itself as a real live human click, webmasters who rely on log files for their traffic numbers may be unaware their stats are skewed. And others complain that LinkScanner has added extra dollars to their bandwidth bill.

Daniel Brandt, who runs Wikipedia Watch (http://www.wikipedia-watch.org/), estimates that LinkScanner traffic to the site has outstripped legitimate clicks by nearly ten times. In this graph, the pink line represents suspected LinkScanner scans, the blue line legitimate clicks:


LinkScanner meets Wikipedia Watch

When we first told the tale (http://www.theregister.co.uk/2008/06/13/avg_scanner_skews_web_traffic_numbers/) of AVG's fake traffic earlier this month, we pointed out that if webmasters were wise to the problem, they could filter LinkScanner visits from their log files. Each scan left a unique user agent: "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;1813)."

But over the weekend, the company changed this user agent on the for-pay version of AVG 8. It appears that scans now use these agents as well:

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)

User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)

User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;1813)

Judging from the log files of two separate web sites, including Wikipedia Watch, the first agent is by far the most common. Which is bad news for webmasters. That's also the Internet Explorer 6 user agent. Unlike the other two - and the original "1813" agent - it's a perfectly valid agent that may turn up with real clicks.

AVG's chief of research Roger Thompson says the for-pay LinkScanner is only using the IE6 user agent. Presumably, the company believes this is more likely to fool malware exploits. "There are still ways for concerned web masters to filter LinkScanner requests out of their statistics," he told us over email. But he did not acknowledge that this could clip legitimate traffic as well.

Many webmasters may have no choice but to abandon log file analysis, adopting alternative tools from companies like Google, Yahoo!, comScore, or Nielsen NetRatings. And these tools have their drawbacks. comScore's service tends to underestimate traffic from daytime work machines. And if you go with Google Analytics, you have to tag your pages with JavaScript - and share your traffic numbers with Google.

Plus, these tools won't solve the bandwidth issue.

In an effort to fix this problem, one web master advocates redirecting AVG scans back to AVG's site. "Many webmasters simply tell LinkScanner to scan AVG's site instead, so their site gets marked as malware free every time - while AVG gets handed the extra bandwidth cost," says the webmaster of TheSilhouettes.org (http://www.TheSilhouettes.org/).

But this assumes that AVG is using a unique agent. And at the moment, it's not. The send-it-back-to-AVG method may redirect legitimate clicks as well.

Which gets to the heart of the matter: AVG's security philosophy is fundamentally at odds with webmaster peace of mind. The company wants to scan search results, and it wants to scan them in a way that's difficult to distinguish from real traffic. "In order to detect the really tricky - and by association, the most important - malicious content, we need to look just like a browser driven by a human being," AVG chief of research Roger Thompson has told us.

And if that causes problems for webmasters, Thompson says, so be it. "I don't want to sound flip about this, but if you want to make omelets, you have to break some eggs."

Clearly, the company doesn't fully realize the importance of web analytics. "Web analytics is about finding trends which can help online marketers/webmasters improve things for their visitors and their businesses," says Steve Jackson, co-chair of the International Web Analytics Association. "It's a big part of the whole online ecosystem in a fast growing up industry.

"No-one wants spyware or viruses, and AVG does provide a useful service which is getting better all the time. I wish, however, they would take business needs into account before launching software that makes life even more difficult for the people trying to do the analytics. Web analytics is not easy at the best of times, and this kind of thing from AVG just compounded the problem.

"In order to make an omelet you have to crack some eggs. But a good omelet has cheese, ham, peppers, mushrooms and all sorts of other ingredients which AVG seem to have forgotten about."

But AVG continues to say it's working to solve the problem - including the bandwidth issue. Referring to LinkScanner's new IE6-like user agent, Thompson told us, "We intend to leave those in place until we can find the right balance point which will allow us to continue to provide the best possible protection for our customers, without imposing too much extra bandwidth on websites." ®


TOPICS: Computers/Internet
KEYWORDS: antivirus; avg; bandwidthhog; fake; linkscanner; traffic
Navigation: use the links below to view more comments.
first 1-2021-4041-6061-71 next last

1 posted on 06/27/2008 12:05:45 PM PDT by LibWhacker
[ Post Reply | Private Reply | View Replies]

To: LibWhacker

Interesting read. I use AVG Free Edition and love it.


2 posted on 06/27/2008 12:07:41 PM PDT by Slapshot68
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

Haven’t used AVG for a while. I use Spyware Terminator, MS Defender, HiJack This, Spybot, AdAware for scanning.


3 posted on 06/27/2008 12:10:39 PM PDT by Coffee200am
[ Post Reply | Private Reply | To 1 | View Replies]

To: Slapshot68

Yes, I’ve used it for many years and absolutely love it. It’s worry-free, install and forget. Genius. Unfortunately, it’s not free anymore (we knew it couldn’t last) and I keep getting a popup warning to upgrade to version 8.0 ($60). I’m trying to decide whether or not to upgrade or go back to one of the other anti-virus packages.


4 posted on 06/27/2008 12:13:59 PM PDT by LibWhacker
[ Post Reply | Private Reply | To 2 | View Replies]

To: LibWhacker

One word, “Linux”

hehe


5 posted on 06/27/2008 12:16:33 PM PDT by Rick.Donaldson (http://www.transasianaxis.com - Please visit for latest on DPRK/Russia/China/et al.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Coffee200am
Ad-Aware and Spybot were great back in 2004 or so, but I don't find them to be powerful enough anymore. I go with these, if you wish to check them out yourself:

AntiVir

Malwarebytes Anti-Malware

SuperAntiSpywware

6 posted on 06/27/2008 12:17:29 PM PDT by library user (There's no sandwich like prawn sandwich.)
[ Post Reply | Private Reply | To 3 | View Replies]

To: LibWhacker

Are you sure you can’t go back to an older version of AVG but still get the latest virus definitions - all for free? I remember hearing that there’s some workaround and that it still is free. I could be wrong, though...


7 posted on 06/27/2008 12:19:27 PM PDT by library user (There's no sandwich like prawn sandwich.)
[ Post Reply | Private Reply | To 4 | View Replies]

To: LibWhacker

I believe there is an AVG 8 free edition, too. Look about their site a bit...


8 posted on 06/27/2008 12:20:07 PM PDT by Smokin' Joe (How often God must weep at humans' folly.)
[ Post Reply | Private Reply | To 4 | View Replies]

To: rdb3; Calvinist_Dark_Lord; GodGunsandGuts; CyberCowboy777; Salo; Bobsat; JosephW; ...

9 posted on 06/27/2008 12:20:07 PM PDT by ShadowAce (Linux -- The Ultimate Windows Service Pack)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

AVG 8.0 can be downloaded free. They aren’t going to make that obvious to 7.5 users, but it’s not hard to find.

I’m pretty sure that the web safety checker is optional when you install.


10 posted on 06/27/2008 12:21:59 PM PDT by js1138
[ Post Reply | Private Reply | To 4 | View Replies]

To: LibWhacker
Unfortunately, it’s not free anymore

Sure it is...just go to free.grisoft.com. I'm running version 8.0 free edition right now.
11 posted on 06/27/2008 12:22:44 PM PDT by politicket
[ Post Reply | Private Reply | To 4 | View Replies]

To: LibWhacker

It’s still free, though I admit it is not obvious that there is a free version if you visit there website or look at the upgrade popup warning.

Go to www.cnet.com and to the downloads section. Look for the most popular downloads and there at the top will be the free AVG version.


12 posted on 06/27/2008 12:23:23 PM PDT by Wolverine83
[ Post Reply | Private Reply | To 4 | View Replies]

To: LibWhacker
AVG is still free - see here: AVG Free Edition
13 posted on 06/27/2008 12:23:45 PM PDT by NMR Guy
[ Post Reply | Private Reply | To 4 | View Replies]

To: LibWhacker

I have 8.0 AVG free edition. Can’t remember where I got it? but it took a little time to find. Good luck


14 posted on 06/27/2008 12:24:54 PM PDT by vacuumbob
[ Post Reply | Private Reply | To 4 | View Replies]

To: NMR Guy

Heheh - I believe we have a consensus: AVG Is Still Free


15 posted on 06/27/2008 12:25:07 PM PDT by NMR Guy
[ Post Reply | Private Reply | To 13 | View Replies]

To: LibWhacker
AVG 8.0 Free Edition
16 posted on 06/27/2008 12:26:46 PM PDT by 2nd amendment mama ( www.2asisters.org | Self defense is a basic human right!)
[ Post Reply | Private Reply | To 4 | View Replies]

To: LibWhacker

I turned that stupid scanner off. I like AVG, but my quad-core box came to a screeching halt every time the scanner went off hitting dozens of sites in the search results. It wasn’t worth the lost time.


17 posted on 06/27/2008 12:27:13 PM PDT by Redcloak ("Yes, I have been drinking. Why do you ask?" #1 on the list of "things heard from McCain voters")
[ Post Reply | Private Reply | To 1 | View Replies]

To: LonePalm
Self Ping for later.

Garde la Foi, mes amis! Nous nous sommes les sauveurs de la République! Maintenant et Toujours!
(Keep the Faith, my friends! We are the saviors of the Republic! Now and Forever!)

LonePalm, le Républicain du verre cassé (The Broken Glass Republican)

18 posted on 06/27/2008 12:27:53 PM PDT by LonePalm (Commander and Chef)
[ Post Reply | Private Reply | To 6 | View Replies]

To: library user; Smokin' Joe; js1138; politicket; Wolverine83; NMR Guy

Wow, THANKS, guys! I LOVE FR!!! :-)


19 posted on 06/27/2008 12:27:57 PM PDT by LibWhacker
[ Post Reply | Private Reply | To 7 | View Replies]

To: LibWhacker

I was a big AVG 7.5 fan but uninstalled their new 8.0 because it killed the performance of my machine. It’s giant bloatware now too. Still looking for an alternative or something closer to the speed of 7.5 but haven’t found it.


20 posted on 06/27/2008 12:27:59 PM PDT by weef
[ Post Reply | Private Reply | To 1 | View Replies]


Navigation: use the links below to view more comments.
first 1-2021-4041-6061-71 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson