clock menu more-arrow no yes

Filed under:

Google creates Octane benchmark suite to measure 'the modern web'

New, 91 comments

Google's new Octane benchmark suite hopes to accurately measure a browser's speed on the modern web.

Google Chrome Logo CloseUp
Google Chrome Logo CloseUp

Google wants to move web development forward with a new JavaScript benchmark suite called Octane. The new benchmark tool adds five new tests to Google's V8 Benchmark Suite that are supposed to reflect modern browser use — tasks like loading PDF files are joined by emulating a Gameboy's architecture to run a 3D demo. Google hopes to supplant popular tools like SunSpider, claiming that existing benchmarks rely on antiquated, artificial tests, and don't accurately reflect what a user is doing on the modern web.

Octane delivers a score that aims to rank browser performance across all platforms, but it's hard to place real-world meaning to the results until we spend more time observing how they line up with our own feelings of browser performance. For what it's worth, in our unscientific battery of tests on a 2011 Macbook Air Chrome version 21 earned an average of about 9,700, while Safari 6 earned an average of about 7,000 (higher is better).

Head on over to the Octane page if you're interested in checking the tests out yourself. Google offers a breakdown of the suite that details what they're measuring at every step.There's also a compatibility chart that offers a birds-eye view of some known issues with the benchmark; the Android browser fails on a pair of the new tests, while both Safari and Chrome fall victim to iOS restrictions. On the desktop end, Internet Explorer 9 is currently incompatible.