02-Overview, The Test Suite and Top-Level Results
TweetFollow Us on Twitter

02-Overview, The Test Suite and Top-Level Results

Overview

We won't keep you in suspense. When we look at the "big picture" of all the top-level test results, Parallels is, once again, the clear winner. Let's look at this in three groups of tests.

If you look at all the tests, including the 3DMark06 detailed tests, Parallels won over 68% by 5% or more, 56.9% of the tests by 10% or more, and 31.7% by 25% or more. VMware Fusion won 7% of these tests by 5% or more, 3.7% by 10% or more, and 0.2% by 25% or more. In 24% of the tests, the two products were within 5% of each other (i.e., they tied).

In our general and top level tests, which gives a good variety of challenges including top level 3D Graphics tests (but drops the detailed graphics tests), Parallels won over 68% by 5% or more, 55% of the tests by 10% or more, 27% by 25% or more. VMware won 7% of these tests by 5% or more, 4.5% by 10% or more, and 0.3% by 25% or more. Just over 24% were a tie.

Figure 1: Test Tally: General Virtualization Tests

If you focus exclusively on 3D graphics, as measured by 3DMark06, Parallels won by an even larger margin. Specifically, Parallels won 62.6% of the tests by 10% or more, and was also a bit faster (at least 5%) on an additional 8.9% more of the tests, and tied on the rest. VMware Fusion 5.0.2 was faster than Parallels in 4.4% of the 3D graphics tests we ran.

3DMark06 has three main aggregate scores. The most important of which is the "3DMark Score." In addition, SM2.0 Score measures 3D Shader Model 2.0 performance, and the HDR/SM3.0 Score measures the 3D Shader Model 3.0 & HDR performance.

Figure 2: Test Tally: 3D Graphics Tests

There are a handful of places where VMware Fusion consistently was faster than Parallels Desktop. For example, successive launches of Microsoft Word were faster (usually by about a quarter of a second). Also, when running OS X as a guest, VMware was consistently faster on shut down of the guest.

Parallels Desktop has power management features that stretch your battery life. On the MacBook Pro, we saw about 40% more battery time on an idling virtual machine with Internet Explorer open (which results in about two hours of additional use) than we did on VMware Fusion in the same test in Windows 7. Parallels ran Windows 8 about 40 minutes longer as well before running out of juice.

One of the best ways to visualize the huge amount of data points is through MacTech's well-known "Colored Cell Worksheet Overview." In these worksheets, a cell represents the best result for each test for each version of Windows for each virtualization product. These are then colored according to which product was faster.

Green cell coloring means Parallels Desktop was faster than VMware Fusion. A blue cell coloring indicates VMware Fusion was faster than Parallels Desktop. Scores that were within 5% of one another are considered a tie. Coloring darkness has four thresholds: >5%, >10%, >25% and double the speed or more. (Note: Not all tests were run on all configurations, hence the empty cells.)

Figure 3: MacTech's Colored Cell Worksheet Overview

Obviously, when you look at the amount of green on the worksheet, you can see that Parallels was faster in the vast majority of tests that we ran. That said, VMware has made improvements in overall speed since the last time we looked at these two products.

The Test Suite and Results

In the sections below, we'll walk you through what we tested, and the results for each. These tests are designed to arm you with the information so you can make the best decision for your type of use.

For each set of results, you can see the analysis for each model of computer running Windows 7 and 8. If you want to see more detail on the tests or on an individual Mac model, you may want to review the spreadsheet for those details.

As you look through the charts below, pay attention to whether the better result is represented by taller or shorter bars. For vertical bars, taller is better. For horizontal bars, shorter is better. See the lower left corner of each chart as a reminder.

For the launch tests (launching the VM, Booting Windows, and Suspend/Resume), we had the option of an "Adam" test and a "Successive" test. Adam tests are when the computer has been completely restarted (hence avoiding both host and guest OS caching). Successive tests are repeated tests without restarting the machine in between tests, and can benefit from caching. Both can mimic real use situations depending on a user's work habits.

The tests used were selected specifically to give a real-world view of what VMware Fusion and Parallels Desktop are like for many users. We didn't focus on the tests that were so short in time frame (e.g., fast) that we could not create statistically significant results, or that had unperceivable differences.

For some of the analysis, we "normalized" results by dividing the result by the fastest result for that test across all the machine configurations. We did this specifically so that we could make comparisons across different groups, and to be able to give you overview results combining a series of types of tests, and computer models.

Instead of a plain "average" or "mean", overall conclusions are done using a "geomean", which is a specific type of average that focuses on the central results and minimizes outliers. Geomean is the same averaging methodology used by SPEC tests, PCMark, Unixbench, and others, and it helps prevent against minor result skewing. (If you are interested in how it differs from a mean, instead of adding the set of numbers and then dividing the sum by the count of numbers in the set, n, the numbers are multiplied and then the nth root of the resulting product is taken).

For those interested in the benchmarking methodologies, see the more detailed testing information in Appendix A. For the detailed results of the tests used for the analysis, see Appendix B. Both appendices are available on the MacTech web site.

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

calibre 6.18 - Complete e-book library m...
Calibre is a complete e-book library manager. Organize your collection, convert your books to multiple formats, and sync with all of your devices. Let Calibre be your multi-tasking digital librarian... Read more
War Thunder 2.25.1.119 - Multiplayer war...
In War Thunder, aircraft, attack helicopters, ground forces and naval ships collaborate in realistic competitive battles. You can choose from over 1,500 vehicles and an extensive variety of combat... Read more
Garmin Express 7.17.0.0 - Manage your Ga...
Garmin Express is your essential tool for managing your Garmin devices. Update maps, golf courses and device software. You can even register your device. Update maps Update software Register your... Read more
Wireshark 4.0.6 - Network protocol analy...
Wireshark is one of the world's foremost network protocol analyzers, and is the standard in many parts of the industry. It is the continuation of a project that started in 1998. Hundreds of... Read more
BBEdit 14.6.6 - Powerful text and HTML e...
BBEdit is the leading professional HTML and text editor for the Mac. Specifically crafted in response to the needs of Web authors and software developers, this award-winning product provides a... Read more
Microsoft OneNote 16.73 - Free digital n...
OneNote is your very own digital notebook. With OneNote, you can capture that flash of genius, that moment of inspiration, or that list of errands that's too important to forget. Whether you're at... Read more
iMovie 10.3.6 - Edit personal videos and...
With a streamlined design and intuitive editing features, iMovie lets you create Hollywood-style trailers and beautiful movies like never before. Browse your video library, share favorite moments,... Read more
Microsoft Remote Desktop 10.8.3 - Connec...
Microsoft Remote Desktop for Mac is an application that allows connecting to virtual apps or another PC remotely. Discover the power of Windows with Remote Desktop designed to help you manage your... Read more
MegaSeg 6.3 - Professional DJ and radio...
MegaSeg is a complete solution for pro audio/video DJ mixing, radio automation, and music scheduling with rock-solid performance and an easy-to-use design. Mix with visual waveforms and Magic... Read more
Carbon Copy Cloner 6.1.6 - Advanced back...
Carbon Copy Cloner is an advanced backup and file copying application for macOS. Looking for something better than Time Machine? With just a few clicks you can set up CCC to make hourly or daily... Read more

Latest Forum Discussions

See All

TouchArcade Game of the Week: ‘Super Cat...
If you have been a reader of this website in any way over the years, chances are pretty good that you’ve heard one of us singing the praises of the Super Cat Tales series at some point in time. The original set the benchmark for unique and intuitive... | Read more »
SwitchArcade Round-Up: ‘Skye Tales’, ‘Fi...
Hello gentle readers, and welcome to the SwitchArcade Round-Up for May 26th, 2023. Gosh, yesterday was quite the day. Counting the few games that popped after I finished my writing, there were forty-five new games that hit the eShop. Today is a... | Read more »
‘Cat Quest: Pirates of the Purribean’ An...
Developer The Gentlebros. released the original Cat Quest way back in August of 2017, and it was a game we had been eyeing for more than a year at that point and were incredibly excited for. In short, it did not disappoint. | Read more »
Minecraft 1.20 Trails and Tales Update R...
Mojang and Microsoft previously revealed the official name and more details for the Minecraft ($6.99) 1.20 update. The Minecraft 1.20 Trails and Tales update was confirmed for release this year, and it has been confirmed to release on June 7th... | Read more »
Apple Arcade Weekly Round-Up: Updates fo...
Just like last week, a few notable games on Apple Arcade have gotten updates this week with no new releases. If you’re wondering why there is no new game this week, Apple’s release of a few Apple Arcade Originals and App Store Greats earlier this... | Read more »
The Latest ‘Marvel Snap’ Update Introduc...
It’s been a busy week over in the world of Marvel Snap (Free). Following on from last week’s big update, this week saw a major new card introduced, a handful of significant balance tweaks over the air, and a new update schedule from the team. I... | Read more »
Recruit yourself a shockingly powerful a...
Tower of Fantasy welcomes their latest simulacrum to the field, and she is one powerful character. The former head of the Listener Project, Dr. Rubilia is swapping research for adventuring and comes with some truly powerful skills. [Read more] | Read more »
‘Yolk Heroes: A Long Tamago’ is a Hybrid...
Virtual pets are pretty cool. Raise, take care of, and ensure the safety of a little virtual creature that lives inside your pocket or on a keychain. Fun stuff. But wouldn’t it be even cooler if that little pet actually, you know, did something... | Read more »
SwitchArcade Round-Up: Reviews Featuring...
Hello gentle readers, and welcome to the SwitchArcade Round-Up for May 25th, 2023. We start things off today with a review of Convergence from our pal Mikhail. After that, it’s new release time. There are somewhere near forty new games hitting the... | Read more »
‘Real Bout Fatal Fury 2’ Review – A Furi...
When it comes to fighting games, the NEOGEO had more than its fair share. Its top three franchises in terms of name recognition were almost certainly The King of Fighters, Samurai Shodown, and Fatal Fury. | Read more »

Price Scanner via MacPrices.net

Apple set to show off new features of iOS 17...
Apple is set to unveil iOS 17 during the WWDC 2023 Keynote speech on June 5th. Here are, briefly, some of the expected features of the new release: When the iPhone is locked and in landscape mode,... Read more
Memorial Day Weekend Sale: 13-inch Apple M2 M...
B&H Photo has 13″ MacBook Pros with Apple M2 processors in stock and on sale today for $200 off MSRP as part of their Memorial Day Weekend sale. Their prices are among the lowest currently... Read more
Memorial Day Weekend Sale: $30 off Apple AirP...
Amazon has Apple AirPods on sale for up to 38% off MSRP as part of their Memorial Day Weekend sale. Shipping is free: – AirPods 2nd-generation: $99 $30 (38%) off – AirPods Pro 2nd-generation: $199.99... Read more
Memorial Day Weekend Sale: Apple Watch Ultra...
Amazon has Apple Watch Ultra models (Alpine Loop, Trail Loop, and Ocean Bands) on sale for up to $97 off MSRP, each including free shipping, as part of their Memorial Day Weekend sale. Their prices... Read more
Memorial Day Weekend Sale: $100 off Apple iPa...
Amazon has 10.9″ M1 WiFi iPad Airs on sale for $100 off Apple’s MSRP, with prices starting at $499, as part of their Memorial Day Weekend sale. Their prices are the lowest available among the Apple... Read more
Memorial Day Weekend Sale: $100 off Apple iPa...
Amazon is offering Apple’s 8.3″ iPad minis for $100 off MSRP, including free shipping, as part of their Memorial Day Weekend sale. Prices start at $399. Amazon’s prices are the lowest currently... Read more
The cheapest M2 Pro-powered Mac is available...
Apple is now offering M2 Pro-powered Mac minis in their Certified Refurbished section starting at $1099 — $200 off MSRP. Each mini comes with Apple’s one-year warranty, and shipping is free. The... Read more
Memorial Day Weekend Sale: Apple AirPods Max...
Amazon has Apple AirPods Max headphones in stock and on sale for $100 off MSRP as part of their Memorial Day Weekend sale. Price is valid for all colors at the time of this post. Shipping is free: –... Read more
Record low price: Open-box 16-inch Apple M1 M...
QuickShip Electronics has open-box return 16″ M1 Max MacBook Pros in stock and on sale for $1200 off original MSRP on their eBay store today. According to QuickShip, “The item in this listing is an... Read more
Open-box 16-inch M2 Pro MacBook Pro available...
QuickShip Electronics has open-box return 16″ M2 Pro MacBook Pros in stock and on sale for $600 off MSRP on their eBay store today, only $1899. According to QuickShip, “The item in this listing is an... Read more

Jobs Board

*Apple* iOS CNO Developer (Onsite) - Raytheo...
…Pacific Boulevard Building CC4, Sterling, VA, 20166-6916 USA Position Role Type: Onsite Apple iOS CNO Developer Cyber Offense and Defense Experts (CODEX) is in need Read more
*Apple* Technician - CompuCom (United States...
…assistance. Join **e** **X** **cell** **!** Our client is currently seeking an ** Apple Technician** to join their team onsite in Bloomfield, CT. This is a Read more
*APPLE* Intermediate Administrative Assistan...
…administrative services related to planning, hosting, and supporting the national APPLE Training Institutes - the leading national substance misuse prevention and Read more
Cashier - *Apple* Blossom Mall - JCPenney (...
Cashier - Apple Blossom Mall Location:Winchester, VA, United States (https://jobs.jcp.com/jobs/location/191170/winchester-va-united-states) - Apple Blossom Mall Read more
Operations Associate - *Apple* Blossom Mall...
Operations Associate - Apple Blossom Mall Location:Winchester, VA, United States (https://jobs.jcp.com/jobs/location/191170/winchester-va-united-states) - Apple Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.