Posted on 01/10/2002 6:12:44 PM PST by Bush2000
New Platform Record on TPC-C Non-Clustered Benchmark Test
Windows Datacenter Server Limited Edition and SQL Server 2000 Advance over UNIX
Las Vegas, NV November 11, 2001 - In his keynote address at Comdex today, Bill Gates announced a significant milestone for Microsoft's enterprise platform: a Unisys ES7000, running Windows Datacenter Server Limited Edition and SQL Server 2000 Enterprise Edition, set a new high-water mark for Windows performance on the prestigious TPC-C Non-Clustered Benchmark test. Auditors clocked this system processing an astounding 165,219 transactions per minute, a new world-record for Windows-based systems. Moreover, at $21.33 per transaction, this result lays claim to the best price-performance of any entry in the top ten performance list, whose remaining systems cost twice as much per transaction on average.
Redefining the Enterprise Operating Environment
Until recently, only UNIX systems could claim a place on the elite top-ten list for TPC-C Non-Clustered (single server) performers. Competition for these spots is intense, and server hardware manufacturers invest millions of dollars and countless hours vying for position. They are often rewarded for this in the marketplace, where enterprise customers rely on the integrity of TPC data as they evaluate new business platforms.
Now Windows is challenging this elite group, and making it hard for proprietary UNIX vendors to justify the high costs of their systems. With the introduction of Windows Datacenter Server on large-scale systems like the 32-processor Unisys ES7000, Windows and SQL Server now have a platform that can be measured against large-scale UNIX systems.
The results have been astounding. With today's announcement, Windows and SQL Server have not only moved to sixth place in the top ten performance list, they have staked a claim to the best price/performance of any system in the group. While the average price/performance of the other top ten performers is approximately $42 per transaction, Windows Datacenter Server Limited Edition is the leader at just over $21 per transaction, nearly twice as cost-effective. Windows has begun to shift the economics of large-scale systems as it has done with smaller servers and personal computers in the past.
A Changing Landscape
The performance record of Windows-based systems is growing with phenomenal speed. Windows has long been the undisputed leader for scalability on smaller systemsthose equipped with one to four processors. Prior to the release of Windows 2000, Windows and SQL Server held four of the top ten performance records in the TPC-C Clustered benchmark. Today, Windows and SQL Server hold every result in the top ten, including the staggering world-record of 709,220 transactions per minute.
With today's result, Windows and SQL Server now hold two of the top ten performance results on the TPC-C Non-Clustered listthe benchmark that measures the performance of large, scale-up systems like the Unisys ES7000. Once the domain of costly proprietary vendors like Sun Microsystems, today's list includes Unisys, IBM, Compaq, HP, Fujitsu, and Bullall members of the Windows 2000 Datacenter Server Program. Sun is no longer found on the top-ten TPC-C Non-Clustered performance list.
Sun's absence is not surprising given the effect Windows has had on the economics of single-server systems. A look at the top ten price/performance results on the TPC-C Non-Clustered benchmark shows that Windows 2000 and SQL Server 2000 occupy every record on the list.
Momentum Going Forward
Windows' performance record has been expanding rapidly, in both scale-up and scale-out arenas. The Windows 2000 Server Family and SQL Server 2000 hold world records on SAP-SD Three-tier, SAP-Retail, PeopleSoft eBill Payment, PeopleSoft 8 CRM, Onyx, Great Plains, and Pivotal eRelationship benchmarks.
Today's announcement marks one of the first results published on Windows Datacenter Server Limited Edition, part of the next generation of the Windows Server Family. With an impressive base of evidence on Windows 2000 and a glimpse of things to come, Windows is poised to extend its performance and scalability leadership well into the future.
Notes: Today's benchmark result was achieved using a 32-way Unisys ES7000 running Windows Datacenter Server Limited Edition and SQL Server 2000 Enterprise Edition. The system performed 165,219 transactions per minute (tpmC) at a cost/transaction of $21.33. The complete system will be available on March 10, 2002, while the Unisys ES7000 and SQL Server 2000 Enterprise Edition are available today. For more details, see http://www.tpc.org.
Sure, but why not cite PC Week, or Information Week, or Yahoo, or CNET, other Ziff-Davis sources, or one of the circulars that come out for Networld/Interop/Comdex? Why not a third-party source from any number of technical news agencies? I am all for technical discussion, but holding up a sales pitch as news isn't news. I would say the same thing about a Sun press release. It's just a press release.
"TPC-A and B benchmarks are into the first phase of their ultimate obsolescence.
It is hoped that the TPC-C benchmark will fill the breach left by TPC-A and TPC-B,
but the initial take up of results has been slower than expected.
The TPC's next benchmark, TPC-D, is in its final review stages
before being officially sanctioned, and is being eagerly awaited by many.
All of this change brings with it uncertainty, and in some cases
people are questioning the worth of TPC testing in general.
Inevitably, one hears statements to the effect that TPC benchmarks are a waste of time, and that they are of no value. "
The current top Sun Processor is the UltraSPARC[tm] III Cu 900-MHz processors.
And if total cost is your goal, you *have* to include Linux. This is how you 'cook the books' to create a great announcement for Bill Gates.
I will now leave this thread to it's regularly scheduled free MS advertising.
An ES7000 with 32 processors and 32gb of memory to achieve these results costs in excess of $950,000. That doesn't count the cost of the Service Contract you have to take with one of these things, because NO ONE ELSE can service them. Tack on about another $80k for the yearly service contract.
A Unix server is still MUCH CHEAPER even if the TPCC's aren't as high. It's HIGHLY UNLIKELY and mid to large size shop is going to need those TPCC's for things like PeopleSoft or SAP. I know, I run a PeopleSoft shop. We looked at moving to PeopleSoft on SQL server, it wasn't as cost effective as what we're doing now, even though the TPCC's were higher. We simply don't need those numbers for what we do.
An ES7000 is a good fit for financial, and high-transactional systems. But for straight Database processing and reporting, Unix is the much better value - STILL.
SQLServer2000 under the Enterprise License agreement I have is $4500 per CPU. On a 32 CPU box like an ES7000 that's $144,000. My existing Oracle license is still cheaper than this. Microsoft thinks they're going to win this battle on pure TPCC counts. They're not. Too many shops have a significant investment in their Unix and back end systems (Oracle, etc..) to just pick up and move to SQL Server. The data conversion isn't the tough part here. The tough part is the process re-engineering, data-flow re-engineering and TRAINING.
Microsoft's margins are the highest of any publically traded technology company on the planet, much higher than Oracle's and much, much higher than Sun's.
From the press relase:
"A look at the top ten price/performance results on the TPC-C Non-Clustered benchmark shows that Windows 2000 and SQL Server 2000 occupy every record on the list."
The "Non-" is a typo. Windows has all of the Clustered results, not all of the Non-Clustered results.
Honestly, I do not think there are any Clustered TPC-C v5 results for UNIX.
The clustered results are kind of irrelevant anyway, since it would be almost impossible to partition a real-world database like the TPC-C database can be partitioned.
Hell, the whole of TPC-C is pretty irrelevant. 2002 marks the tenth anniversary of the benchmark. When TPC-C came out, the typical server was 2 or 4 processors running at 35-40 MHz.
The really interesting information on how irrellevant TPC-C is at http://www.tpc.org/information/about/history.asp
"The TPC-E or Enterprise Benchmark effort was initiated shortly after TPC-C was approved in July, 1992. Proponents of TPC-E argued that while TPC-C was significantly more complex and robust that the earlier TPC-A benchmark, but it still wasn't complex enough to stress very large, enterprise-class systems."
"TPC-E failed to garner enough support for three reasons: 1) the TPC already had one OLTP benchmark (TPC-C), and two benchmarks in this space would only generate industry/user confusion; 2) another benchmark would force vendors to expend precious resources to run another benchmark even more expensive than TPC-C; 3) as an enterprise benchmark, TPC-E was only relevant to a relatively small number of companies competing in that space."
In short, TPC-C a database benchmark meant for small 1-4 processor RISC/UNIX systems with <50 MHz CPUs and a couple of dozen JBOD SCSI 1 disks now claims to be an "enterprise" benchmark, but nobody considered it an enterprise benchmark when it was released a decade ago.
Hmm, what does this really say?
If you go to the Transaction Processing Performance Council's website, go find the Top Ten Non-Clustered TPC-C by Performance Version 5 Results. Look at this table. It is pertinent to this discussion that the page actually shows Microsoft SQL Server 2000 running on the Unisys ES7000 as being number seven in the list with 165,218 transactions. Number one on the list was a Fujitsu PrimePower 2000 showing 455,818 tmpC. So while 165,218 might be a world record for Windows, it's hardly a world record. It is also pertinent to note the Fujitsu ran Solaris 8.
Furthermore, it's kind of a squeeze to suggest Groupe Bull is not a costly proprietary vendor. :P
So, this is a sales pitch. Bully for Microsoft Windows 2000 running on a multiprocessor machine. I don't begrudge their entrance into the market, but you really have to read press releases (not just MS, but anybody's) with a grain of salt.
I wondered about this. Microsoft on Compaq topped the Clustered benchmark, not the Non-Clustered one. You also mentioned that TPM-C is ten years old, which is also pertinent to the discussion because the computing power of the computers has increased dramatically. TPM-C came out in 1991 (1992? about the time the DEC Alpha came out) and some people think it's outdated. Certianly this benchmark will become meaningless at some point, just as statements by Bill Gates that no one will need more than 640KB RAM, or Digital saying 64-bit computing wouldn't catch on.
Does it make you feel better to insult people when you can't answer their questions?
No one should be stupid enough to put their database on .Net. That's what MS is after here, getting corporate databases hooked to .Net.
That's an intelligent response. I state a handful of specific, fact based observations, and you suggest putting my head in the sand will make me feel better?
Of course, another interesting observation about the ES7000 is the fact that both HP and Compaq dumped their OEM agreements with Unisys to offer this system, because there is no market for a 32-way WinTel box (at least not yet).
The ES7000 makes a nice display at a trade show, and is good for high-water mark benchmarks, but until customers trust Windows and SQL Server in the datacenter, it will be a niche machine.
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.