backtop


Print 106 comment(s) - last by chick0n.. on Aug 13 at 11:31 AM


Futuremark, makers of 3DMark, have launched PeaceKeeper, the first comprehensive browser benchmarking suite.

The results are intriguing -- Apple's Safari and Google Chrome are the top browsers speed-wise. Windows 7 beats Windows Vista with similar hardware and the same browser version, but still lags behind OS X. And the hardware on the system, particularly the CPU dramatically influences results.  (Source: PeaceKeeper)
The makers of 3DMark take on the web

Mozilla, Apple, Google, Opera, and Microsoft all claim the same thing -- that their browser is the fastest.  So who is telling the truth? 

Until recently, that was a tough question to answer.  Sure there was a handful of free tests, such as SunSpider's JavaScript benchmark, Celtic Kane's JavaScript benchmark (a bit older), or the crude CSS benchmark posted on HowToCreate.  However, these tests all had one thing in common -- they did not fully test the browser's speed across a variety of rich-content standards.

FutureMark, makers of the popular 3DMark hardware benchmarking software, know all about how to provide a cohesive benchmarking suite.  So amid ongoing work on PCMark, 3DMark, and even a video game (Shattered Horizon), FutureMark decided to try to settle the browser bragging match once and for all by releasing a comprehensive test suite.

The result is the Peacekeeper benchmarking suite, which is now available as a free online applicationDailyTech had the pleasure of talking with FutureMark President Oliver Baltuch and learning more about this exciting new test, as well as some of its more interesting results.

Currently, the test covers page rendering using everything from HTML 5.0 to CSS.  It also includes a number of tests to gauge JavaScript performance with typical algorithms such as encrypts, filters, parses, sorts, and array manipulation.  DOM performance is also tested.  Currently, flash performance tests are not included.  Mr. Baltuch says that a second version is in the works "that would include more of the HTML 5.0 and something that works to measure flash performance as well as possibly power performance."

The core set of tests now simulate conditions that might be encountered on content-heavy pages such as YouTube, Facebook, or Meebo.  The results are intriguing.  For the same browser version tested across different OS implementations running on virtually the same hardware Mr. Baltuch states, "The Apple [computers] tend to be 5-10 percent faster [than Windows machines].  We believe that is based on the middleware of the OS.  We believe that it is more streamlined."

While OS X holds the speed lead, Mr. Baltuch noted that Windows 7 featured substantial gains over Windows Vista.  However, Internet Explorer 8.0, Microsoft's flagship browser remains much slower than the industry's speed-leading browsers -- Google's Chrome and Apple's Safari.  Mr. Baltuch comments, "Windows 7 is faster than Vista is.  But Internet Explorer 8.0 is 5 times slower than Chrome and Safari."

Despite Chrome and Safari being the fastest, Mr. Baltuch says he uses Opera 10.0 beta 2 for browsing because he likes the user interface and features the best.  He also praised Mozilla users for their very helpful feedback.  He says that some browser makers have embraced his company's efforts, while others remain standoffish.

He states, "Some seem to be happy.  The Norwegians (Opera) seem to hate us at the moment (FutureMark is Finnish).  The guys at Microsoft have been silent so far."

For those interested, Peacekeaper is funded by advertising revenue and is also funded by sales of consulting services to large businesses.  Also, the benchmark has helped to increased the adoption of FutureMark's paid products like PCMark, according to Mr. Baltuch.

A couple of final interesting notes.  Mr. Baltuch says that the test is compatible with the popular Apple iPhone.  He also notes that there is a large difference between web performance, going from a netbook processor (such as the Intel Atom) to a high-end desktop processor (such as the Intel Core i7).  This is due to the CPU's pivotal role in running increasingly heavy web applications.  He also says that for users looking to try something off the typical beaten path, the Epiphany (browser packaged with Gnome Linux), Shiira (Webkit-based), and Midori (also Webkit-based) browsers all provide relative good Linux browsing performance.

Mr. Baltuch says his company loves feedback, so feel free to head over to the Peacekeeper page, check it out, and leave your comments.



Comments     Threshold


This article is over a month old, voting and posting comments is disabled

Not conclusive
By adiposity on 8/10/2009 4:12:47 PM , Rating: 2
quote:
Mozilla, Apple, Google, Opera, and Microsoft all claim the same thing -- that their browser is the fastest. So who is telling the truth? Until recently, that was a tough question to answer.


But now that "a benchmarking company" has made a suite of tests, that question has been answered, right?

This is ridiculous. I'm not really questioning the results, but every benchmarking suite has its biases (towards specific types of tests, that is). All this tells us is, which browser is fastest at this benchmarking suite.

Other issues:

I noticed clipping in particle collisions tests, but the test jumps ahead by several frames. It does not appear to lose any speed, just drops frames. Is this taken into account?

The plugins for each browser are written by Futuremark. How do we know each plugin is equally efficient and interfacing with its browser?

The benchmark identifies my CPU as a "core duo mobile" despite the fact that I have a core i7 quad...wtf?

-Dan




"You can bet that Sony built a long-term business plan about being successful in Japan and that business plan is crumbling." -- Peter Moore, 24 hours before his Microsoft resignation














botimage
Copyright 2014 DailyTech LLC. - RSS Feed | Advertise | About Us | Ethics | FAQ | Terms, Conditions & Privacy Information | Kristopher Kubicki