Print 106 comment(s) - last by chick0n.. on Aug 13 at 11:31 AM

Futuremark, makers of 3DMark, have launched PeaceKeeper, the first comprehensive browser benchmarking suite.

The results are intriguing -- Apple's Safari and Google Chrome are the top browsers speed-wise. Windows 7 beats Windows Vista with similar hardware and the same browser version, but still lags behind OS X. And the hardware on the system, particularly the CPU dramatically influences results.  (Source: PeaceKeeper)
The makers of 3DMark take on the web

Mozilla, Apple, Google, Opera, and Microsoft all claim the same thing -- that their browser is the fastest.  So who is telling the truth? 

Until recently, that was a tough question to answer.  Sure there was a handful of free tests, such as SunSpider's JavaScript benchmark, Celtic Kane's JavaScript benchmark (a bit older), or the crude CSS benchmark posted on HowToCreate.  However, these tests all had one thing in common -- they did not fully test the browser's speed across a variety of rich-content standards.

FutureMark, makers of the popular 3DMark hardware benchmarking software, know all about how to provide a cohesive benchmarking suite.  So amid ongoing work on PCMark, 3DMark, and even a video game (Shattered Horizon), FutureMark decided to try to settle the browser bragging match once and for all by releasing a comprehensive test suite.

The result is the Peacekeeper benchmarking suite, which is now available as a free online applicationDailyTech had the pleasure of talking with FutureMark President Oliver Baltuch and learning more about this exciting new test, as well as some of its more interesting results.

Currently, the test covers page rendering using everything from HTML 5.0 to CSS.  It also includes a number of tests to gauge JavaScript performance with typical algorithms such as encrypts, filters, parses, sorts, and array manipulation.  DOM performance is also tested.  Currently, flash performance tests are not included.  Mr. Baltuch says that a second version is in the works "that would include more of the HTML 5.0 and something that works to measure flash performance as well as possibly power performance."

The core set of tests now simulate conditions that might be encountered on content-heavy pages such as YouTube, Facebook, or Meebo.  The results are intriguing.  For the same browser version tested across different OS implementations running on virtually the same hardware Mr. Baltuch states, "The Apple [computers] tend to be 5-10 percent faster [than Windows machines].  We believe that is based on the middleware of the OS.  We believe that it is more streamlined."

While OS X holds the speed lead, Mr. Baltuch noted that Windows 7 featured substantial gains over Windows Vista.  However, Internet Explorer 8.0, Microsoft's flagship browser remains much slower than the industry's speed-leading browsers -- Google's Chrome and Apple's Safari.  Mr. Baltuch comments, "Windows 7 is faster than Vista is.  But Internet Explorer 8.0 is 5 times slower than Chrome and Safari."

Despite Chrome and Safari being the fastest, Mr. Baltuch says he uses Opera 10.0 beta 2 for browsing because he likes the user interface and features the best.  He also praised Mozilla users for their very helpful feedback.  He says that some browser makers have embraced his company's efforts, while others remain standoffish.

He states, "Some seem to be happy.  The Norwegians (Opera) seem to hate us at the moment (FutureMark is Finnish).  The guys at Microsoft have been silent so far."

For those interested, Peacekeaper is funded by advertising revenue and is also funded by sales of consulting services to large businesses.  Also, the benchmark has helped to increased the adoption of FutureMark's paid products like PCMark, according to Mr. Baltuch.

A couple of final interesting notes.  Mr. Baltuch says that the test is compatible with the popular Apple iPhone.  He also notes that there is a large difference between web performance, going from a netbook processor (such as the Intel Atom) to a high-end desktop processor (such as the Intel Core i7).  This is due to the CPU's pivotal role in running increasingly heavy web applications.  He also says that for users looking to try something off the typical beaten path, the Epiphany (browser packaged with Gnome Linux), Shiira (Webkit-based), and Midori (also Webkit-based) browsers all provide relative good Linux browsing performance.

Mr. Baltuch says his company loves feedback, so feel free to head over to the Peacekeeper page, check it out, and leave your comments.

Comments     Threshold

This article is over a month old, voting and posting comments is disabled

RE: Why is browser speed a concern?
By halcyon on 8/10/2009 2:41:01 PM , Rating: 5
Most people today are running sub-2GHz single core computers more than 3 years old.

Yes, Anandtech and general heat-seeking web-using young male readers may be using what you describe and part of the business crowd, but that's about it.

And yes, browser speed does matter to some of us, even if you are not one of them.

Don't mistake everybody else to have the same needs as you.

As more and more apps are moving to the browser and the cloud, it makes sense to test the browser speed, esp. complex HTML 5.0 / CSS and EcmaScript speeds.

In a few years we'll all be happy that somebody pushed the browser vendors to shape up their rendering / compilation speeds.

RE: Why is browser speed a concern?
By tastyratz on 8/10/2009 3:18:13 PM , Rating: 5
Plus: its measuring browser speed- not the capabilities of your computer and how much the browser will load you down. There are latencies and inefficiencies in certain operations that can cause something such as a web browser to display a page slower even when its not limited by computational power. An example would be some pages that just take an extra second or 2 to come up even though its not a web slowdown and it might only be using 10% cpu.

RE: Why is browser speed a concern?
By B3an on 8/11/2009 1:32:00 AM , Rating: 3
I'd like to add that even on my 4.2GHz i7 with 12GB DDR3 RAM i can easily notice that Chrome is faster than FF3.5, and especially IE8 at loading pages.

So the argument about computers being so fast now that browser speed does not matter is pure cr*p. If i was to have a 10GHz i7 i'm positive i'd still notice Chrome being faster, because it's not down to CPU/hardware speed.

RE: Why is browser speed a concern?
By B3an on 8/11/2009 1:33:34 AM , Rating: 2
Not all down to CPU/hardware speed i meant.

By Mojo the Monkey on 8/11/2009 1:35:31 PM , Rating: 3
Dang, and here I was with my lowly 4.1ghz i7 and 11GB DDR3 RAM, not noticing any difference at all. I have to get my hands on that last .1 gzh and gig of ram.

RE: Why is browser speed a concern?
By rs1 on 8/10/2009 5:49:11 PM , Rating: 2
I mostly agree, except for the part about it making sense to test HTML 5. Virtually nothing actually uses HTML 5 right now (apart from a handful of interesting but mostly useless tech demos), despite its popularity in the press. While HTML 5 benchmarks will likely be important in the future, they are of little use right now, and because most browsers are just rolling out the initial iteration(s) of their HTML 5 engines I think any benchmark results would be misleading at best (especially if trying to draw conclusions about which browser is "fastest"). The performance of all the different HTML 5 engines is likely to change significantly once people start using it to implement real applications and the browser developers get a sense of how people are going to use HTML 5 in real life.

RE: Why is browser speed a concern?
By headbox on 8/10/2009 6:24:22 PM , Rating: 5
Thanks for your comment. The first few sound like people who say "the speed limit is 55, why would I want a Corvette?"

My kids play free games online. Sites like Disney, Nickelodeon, Cartoon Network, etc. all have some heavy browser-based games. Performance is important and noticeable. It's also noticeable on media-heavy sites, like those made by music groups or animators. Not everyone is on a Core i7 while looking at craigslist.

RE: Why is browser speed a concern?
By erple2 on 8/11/2009 1:41:49 PM , Rating: 2
In that case, you're talking about flash performance. And I don't think that there's an appreciable difference between browsers and platforms for flash.

By JoshuaBuss on 8/12/2009 10:40:23 AM , Rating: 3
you're crazy. try IE8 on youtube then try chrome..

RE: Why is browser speed a concern?
By Keeir on 8/10/2009 7:21:24 PM , Rating: 2
I would add to this that 1-2 seconds difference may not mean anything for one page loading, but when dealing with mobile applications, 1-2 seconds several times a minute really add up to more productivity per battery life.

Also, loading 100-200 pages a day. 1 second a page is more than a minute a day, and several hours over the course of a year... and this holds true for almost all level of time savings... switchings from IE8 to Firefox to Safari means hours a year for pretty much any user.

"The Space Elevator will be built about 50 years after everyone stops laughing" -- Sir Arthur C. Clarke

Most Popular ArticlesAre you ready for this ? HyperDrive Aircraft
September 24, 2016, 9:29 AM
Leaked – Samsung S8 is a Dream and a Dream 2
September 25, 2016, 8:00 AM
Inspiron Laptops & 2-in-1 PCs
September 25, 2016, 9:00 AM
Snapchat’s New Sunglasses are a Spectacle – No Pun Intended
September 24, 2016, 9:02 AM
Walmart may get "Robot Shopping Carts?"
September 17, 2016, 6:01 AM

Copyright 2016 DailyTech LLC. - RSS Feed | Advertise | About Us | Ethics | FAQ | Terms, Conditions & Privacy Information | Kristopher Kubicki