TweetFollow Us on Twitter

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion

Volume Number: 25 (2009)
Issue Number: 04
Column Tag: Virtualization

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion (cont.)

How do VMware Fusion and Parallels Desktop for Mac stack up?

by Neil Ticktin, Editor-in-Chief/Publisher

Start | 1 | 2 | 3 | 4

Application Performance Tests

In many cases, applications today, perform so well and so fast, even under virtualized environments, that anyone would be pleased for small documents and activities. We focused our efforts on larger tasks that were not only large enough to measure, but will also stress the systems to some extent.

For Microsoft Word, we took a very large document and did a global search and replace of about 95,000 items. For Microsoft Excel, we ran a macro that generated a large quantity of random numbers, and filled cells with them. And, for PowerPoint, we had the application render slides with transitions as quickly as possible (all the other PowerPoint tests worked too fast to measure).

  • Word Global Find & Replace

    • XP: Parallels Desktop 4% faster (range: 0.5 seconds slower to 6.5 seconds faster, fastest: 34 seconds)

    • Vista: Parallels Desktop 9% faster (range: 14 seconds slower to 21 seconds faster, fastest: 42 seconds)

  • Excel Macro Test

    • XP: Parallels Desktop 14% faster (range: 0.5-1.6 seconds faster, fastest: 5.5 seconds)

    • Vista: Parallels Desktop 13% faster (range: 0.3-1.3 seconds faster, fastest: 4.5 seconds)

  • PowerPoint View slide transitions

    • XP: VMware Fusion 2% faster (range: 0.2 seconds slower to 0.2 seconds faster, fastest: 5.5 seconds)

    • Vista: Both performed almost the same (range: 4.7-5.6 seconds)


    Figure 6: Windows Application Performance

    Many web pages are simple enough that they load very quickly. So, to test the speed of Internet Explorer, we created a large, complex page in HTML loaded from a local LAN server. The page was very long, but used only common HTML elements, (no JavaScript, etc.). But, for whatever reason, VMware Fusion took significantly longer ... sometimes, an order of magnitude longer--across the board. As a result, we removed this test from the overall analysis (the average of averages ... or more technically, the geomean of geomeans) so that it wouldn't skew the overall results.

    The tests performed used the same web page ... with and without SSL.

    • Internet Explorer Load complex web page

      • XP: Parallels Desktop 82% faster (range: 40-60 seconds faster, fastest: 9 seconds)

      • Vista: Parallels Desktop 91% faster (range: 79-126 seconds faster, fastest: 9 seconds)

    • Internet Explorer Load complex web page (SSL)

      • XP: Parallels Desktop 80% faster (range: 40-60 seconds faster, fastest: 11 seconds)

      • Vista: Parallels Desktop 84% faster (range: 54-80 seconds faster, fastest: 10 seconds)


    Figure 7: Internet Explorer Application Performance

    Footprint Tests

    One of the most interesting things in the virtualization market is how little overhead virtualization takes today compared to what it used to. To assess this, we measured in a variety of ways. Specifically, we focused on CPU usage (overall for the Mac), real memory usage (overall for the Mac), and how long the battery would last. CPU and memory usage were measured using "top" (a command line tool that's part of UNIX with a minimum of 50 continuous samples averaged for the result).

    We ran three CPU usage tests. The first test was to boot Windows and let it sit for a few minutes to finish up its startup activities. Once done, CPU use was measured while both the Mac OS X and Windows were sitting idle. The next test studied the same thing except both Microsoft Word and Microsoft Outlook were launched and left sitting idle. The last test explored CPU usage while playing a DVD.

    (Note: For testing the playing of a DVD, we had a bit of a challenge. Parallels Desktop supports the default application for playing DVDs that comes with Windows (Windows Media Player), but we had problems with WMP under VMware Fusion. Their web site also talks about these issues. As a workaround, VMware suggests the open source VLC Player, but we had trouble getting VLC Player to work in Parallels Desktop. It was important for both virtualization environments to use the same application, so we used Media Player Classic for the tests.)

    For the two idle tests, both virtualized environments did very, very well with only 2-5% of the CPU being used. So, while one may be 1/3 or more faster, it's not a significant difference to the user in real terms.

    • CPU use for sitting idle (in %)

      • XP: Parallels Desktop used 1/3rd less CPU (range: 1-8% CPU use)

        Vista: Parallels Desktop used 1/3rd less CPU (range: 1-9% CPU use)

    • CPU use for VM sitting idle with both Word/Outlook (in %)

      • XP: Parallels Desktop used 1/5th less CPU (range: 1-8% CPU use)

      • Vista: Parallels Desktop used 1/7th less CPU (range: 1-10% CPU use)

    • CPU use for play DVD (in %)

      • XP: About the same (range: 3-33% CPU use)

      • Vista: Parallels Desktop used 1/25th less CPU (range: 3-36% CPU use)


    Figure 8: Virtual Machine CPU Usage

    The memory footprint was done for two idle tests, similar to the CPU usage tests above. Here, however, the differences were more meaningful, and would be noticeable to the user. Take note, we're looking at both 1GB and 2GB virtual machines here.

    • Real Memory use for sitting idle (in MB)

      • XP: Parallels Desktop used 48% less RAM (range: 716-1748 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 274-1125 MB less)

    • Real Memory use for VM sitting idle with both Word/Outlook (in MB)

      • XP: Parallels Desktop used 39% less RAM (range: 527-1567 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 257-1109 MB less)


    Figure 9: Virtual Machine Memory Usage

    Take note, Parallels is doing something interesting here with memory allocation: Parallels Desktop only takes memory from Mac OS X when Windows needs it. In other words, if you have a 2GB virtual machine, it will initially take less than 2GB of memory from the Mac, until you've opened enough application or documents that Windows needs the RAM. By contrast, VMware Fusion appears to allocate all the memory for the virtual machine at launch.

    For the exhaust battery test, we ran an "endless loop" macro in Excel that generated random numbers. When approaching the end of battery, Parallels Desktop will pause the virtual machine, and ultimately, the Mac will go into a hibernate mode saving off where things are at. VMware Fusion will suspend the virtual machine before sleeping.

    • Exhaust Battery: Endless Macro in Excel

      • XP: Parallels Desktop battery usage lasted 8% longer (9 minutes longer for 99 min total)

      • Vista: Parallels Desktop battery usage lasted 9% longer (9 minutes longer for 92 min total)


    Figure 10: Virtualized Machine Battery Performance

    File and Network IO Tests

    Originally, we ran file copy tests on all the environments. In analyzing the results, we realized that there was a huge problem. Mac OS X and Windows were interfering, in a good way for typical users, with the results. Both Mac OS X and Windows have some pretty sophisticated caching schemes, but they also made File and Network IO tests unpredictable. As just one example, sometimes a MacBook was faster than a Mac Pro, and other times it was not. In the end, we tossed out the several hundred test times, and re-tested.

    Due to time constraints, the retests focused solely on the MacBook Pro. To avoid the interaction problems with Mac OS X and Windows, we tested using data set sizes that were about the same size as the physical memory, or larger. This prevented the Mac and Windows from any type of caching. The data sets we copied from one location to another were 3.7GB total (two 1.85GB files because we needed to stay below the 2GB file limit).

    The same set of files was used for all the copies so that you can see the differences between the different methods of copying. (Most of which were in the same relative time frame, except for copying to a USB Flash Drive. See the chart.)

    Networking was done via the default NAT setup in both virtualized environments, and the defaults for disk setup for each application were used as well.

    Here were the results:

    • File copy - duplicate on local virtual hard drive

      • XP: Parallels Desktop 31% faster (75 seconds faster, fastest: 165 seconds)

      • Vista: Parallels Desktop 43% faster (137 seconds faster, fastest: 181 seconds)

    • File copy - to local Mac hard drive

      • XP: Parallels Desktop 11% faster (18 seconds faster, fastest: 149 seconds)

      • Vista: VMware Fusion 8% faster (14 seconds faster, fastest: 181 seconds)

    • File copy - from local Mac hard drive

      • XP: Parallels Desktop 36% faster (94 seconds faster, fastest: 167 seconds)

      • Vista: Parallels Desktop 42% faster (134 seconds faster, fastest: 182 seconds)

    • File copy - to LAN Server

      • XP: Parallels Desktop 35% faster (113 seconds faster, fastest: 213 seconds)

      • Vista: Parallels Desktop 16% faster (36 seconds faster, fastest: 186 seconds)

    • File copy - from LAN Server

      • XP: Parallels Desktop 28% faster (70 seconds faster, fastest: 176 seconds)

      • Vista: Parallels Desktop 14% faster (27 seconds faster, fastest: 168 seconds)

    • File copy - to USB Flash Drive

      • XP: Parallels Desktop 6% faster (53 seconds faster, fastest: 774 seconds)

      • Vista: Parallels Desktop 4% faster (37 seconds faster, fastest: 859 seconds)

    • File copy - from USB Flash Drive

      • XP: Parallels Desktop 15% faster (52 seconds faster, fastest: 300 seconds)

      • Vista: VMware Fusion 8% faster (22 seconds faster, fastest: 283 seconds)

    Or, said much better on a graph, it looks like this:


    Figure 11: Virtual Machine File and Network I/O Performance



    Start | 1 | 2 | 3 | 4
  •  

    Community Search:
    MacTech Search:

    Software Updates via MacUpdate

    OmniOutliner Pro 5.4.1 - Pro version of...
    OmniOutliner Pro is a flexible program for creating, collecting, and organizing information. Give your creativity a kick start by using an application that's actually designed to help you think. It's... Read more
    EarthDesk 7.3 - $24.99
    EarthDesk replaces your static desktop picture with a rendered image of Earth showing correct sun, moon, and city illumination. With an Internet connection, EarthDesk displays near-real-time global... Read more
    Monosnap 3.5.3 - Versatile screenshot ut...
    Monosnap lets you capture screenshots, share files, and record video and .gifs! Features Capture Capture full screen, just part of the screen, or a selected window Make your crop area pixel... Read more
    Monosnap 3.5.3 - Versatile screenshot ut...
    Monosnap lets you capture screenshots, share files, and record video and .gifs! Features Capture Capture full screen, just part of the screen, or a selected window Make your crop area pixel... Read more
    Spotify 1.0.93.244 - Stream music, creat...
    Spotify is a streaming music service that gives you on-demand access to millions of songs. Whether you like driving rock, silky R&B, or grandiose classical music, Spotify's massive catalogue puts... Read more
    Evernote 7.6 - Create searchable notes a...
    Evernote allows you to easily capture information in any environment using whatever device or platform you find most convenient, and makes this information accessible and searchable at anytime, from... Read more
    Final Cut Pro X 10.4.4 - Professional vi...
    Final Cut Pro X is a professional video editing solution. Completely redesigned from the ground up, Final Cut Pro adds extraordinary speed, quality, and flexibility to every part of the post-... Read more
    Compressor 4.4.2 - Adds power and flexib...
    Compressor adds power and flexibility to Final Cut Pro X export. Customize output settings, work faster with distributed encoding, and tap into a comprehensive set of delivery features. Features... Read more
    Motion 5.4.2 - Create and customize Fina...
    Motion is designed for video editors, Motion 5 lets you customize Final Cut Pro titles, transitions, and effects. Or create your own dazzling animations in 2D or 3D space, with real-time feedback as... Read more
    Thunderbird 60.3.1 - Email client from M...
    As of July 2012, Thunderbird has transitioned to a new governance model, with new features being developed by the broader free software and open source community, and security fixes and improvements... Read more

    Latest Forum Discussions

    See All

    Slots Panther Vegas offers a social gamb...
    New era of Online gambling Want to try your luck in online social gambling? More and more people are into online casinos as a risk-free amazing way to experience the excitement of a big game. Online casinos and slots machines are gaining popularity... | Read more »
    3 features we think you'll love in...
    Well known classic RPG “Shin Megami Tensei” franchise originally created by Atlus, can now be played throughout iOS and Android. Created by Sega, “Shin Megami Tensei” has spawned a mobile-centric installment in the shape of “Shin Megami Tensei:... | Read more »
    These are the top 3 games for iPhone and...
    The end of the week has rolled around again, which means it's time for us to look forward to the games you're going to be playing over the next seven days. We've got the return of a mobile gaming legend next week, as well as a couple of other... | Read more »
    Time for you to pick which of these top...
    Oh look, Thursday is upon us once more. And we all know what that means! You guessed it, it's time for you to vote for which of these five games you think deserves to win our game of the week award. And have we got a selection for y'all this week... | Read more »
    Dragalia Lost - High Midgardsormr Prep G...
    It might not seem like there's a ton to do between events in Dragalia Lost, but there is one high level piece of content that can keep you occupied for a long time. Defeating High Midgardsormr is currently the game's most difficult non-event... | Read more »
    Get your friends, these are the top 5 be...
    You can't be a lone wolf all the time, especially if you want to show off your gaming prowess. And that's where this list comes in - we're running down what we think are the top 5 multiplayer games for iPhone. There might be some controversial... | Read more »
    SpitKiss is the worthy winner of last we...
    It's been a rough and tumble battle this week, with all of the games managing to get a few hits in where it counts, but after checking with the independent adjudicators at ringside, we can now reveal that gloriously gross smooching sim SpitKiss has... | Read more »
    The best games for iPhone - The definiti...
    Hi there, and welcome to our ever-increasing list of the very best games for iPhone. We're going to be updating this regularly with new content, so make sure you check back often, because you're not going to want to miss out on even one of the... | Read more »
    Dragalia Lost Guide - What You Need To K...
    Another raid has come and gone in Dragalia Lost, but that doesn’t mean there’s not still lots to do. In fact, the game’s next event, A Wish to the Winds, has already been announced and will be coming to the game this Wednesday. Although details are... | Read more »
    The top 5 best games like Star Wars: Gal...
    One of the things we like to do here at 148Apps is broaden your horizons. Maybe you're a fan of Star Wars: Galaxy of Heroes and you're looking for something that's going to scratch similar itches? Well that's where we come, and more specifically... | Read more »

    Price Scanner via MacPrices.net

    Save on a new MacBook with these early Black...
    B&H Photo has posted early Black Friday sale prices on Apple MacBooks, including up to $300 off MSRP on 15″ MacBook Pros, $100 off new 13″ MacBook Airs, and more. Most of these deals expire... Read more
    T-Mobile Black Friday deal: Free iPhone Xr wi...
    T-Mobile is offering the 64GB iPhone Xr for free as part of their Black Friday 2018 sale. Two new lines are required, as well as an eligible trade-in (iPhone 6s models or newer). $20.84 is applied to... Read more
    Save up to $157 on a 10.5″ iPad Pro with thes...
    Apple’s newest authorized reseller, Jet, has 10.5″ iPad Pros on sale for up to $157 off MSRP as part of their Black Friday week sale. Shipping is free. Note that some sale prices may be restricted to... Read more
    US Cellular offers free iPhone Xr for new lin...
    US Cellular is offering the 64GB iPhone Xr for free as part of their Black Friday 2018 sale. A new line is required, but there is no trade in requirement. Any of the iPhone Xr colors qualify. The... Read more
    Roundup of Black Friday Week 2018 Sales &...
    At MacPrices.net, we give you the most accurate Mac and Apple prices on the web. Choose one of our price trackers at the top of the page to see all the current sale prices on Apple’s products from... Read more
    Details of Amazon’s 2018 Black Friday week di...
    Amazon’s recent agreement with Apple has allowed the online store to add most of Apple’s most popular products to its inventory, including new 2018 iPad Pros, Mac minis, Apple Watch Series 4, and... Read more
    Get A Job With Apple, The No. 3 ‘World’s Best...
    FEATURE: 11.16.18- If you are a fan of Apple, Inc. and an avid user of any one of its vast array of tech gadgets, why not take it a step further and work for the company behind those products you... Read more
    Sprint offers $100 discounts on Apple Watch S...
    Sprint is offering customers $100 discounts on the purchase of a cellular Apple Watch Series 4 or Apple Watch Series 3. Their discount reduces the cost of a Series 4 watch to $399 (40mm) or $429 (... Read more
    New 2018 11″ 64GB & 256GB iPad Pros in st...
    MacMall has the new 2018 11″ 64GB and 256GB iPad Pros in stock today for $50 off Apple’s prices. They’re currently the lowest prices available for these new iPad Pros. – 11″ 64GB Space Gray WiFi iPad... Read more
    New Mac minis in stock and available today at...
    Apple Authorized Reseller Adorama has the new 2018 Mac minis in stock today today sales tax free for residents outside of NY & NJ. Shipping is also free. – 3.6GHz Quad-Core mini: $799 – 3.0GHz 6... Read more

    Jobs Board

    Best Buy *Apple* Computing Master - Best Bu...
    **658102BR** **Job Title:** Best Buy Apple Computing Master **Job Category:** Sales **Location Number:** 000395-Pensacola-Store **Job Description:** **What does a Read more
    *Apple* Mobile Master - Best Buy (United Sta...
    **658022BR** **Job Title:** Apple Mobile Master **Job Category:** Store Associates **Location Number:** 000793-Dothan-Store **Job Description:** **What does a Best Read more
    Geek Squad *Apple* Master Consultation Agen...
    **657784BR** **Job Title:** Geek Squad Apple Master Consultation Agent **Job Category:** Services/Installation/Repair **Location Number:** 000597-Erie-Store **Job Read more
    Best Buy *Apple* Computing Master - Best Bu...
    **655276BR** **Job Title:** Best Buy Apple Computing Master **Job Category:** Sales **Location Number:** 000387-Randall Road-Store **Job Description:** **What does a Read more
    Omni-Channel Associate - *Apple* Blossom Ma...
    Omni-Channel Associate - Apple Blossom Mall Location:Winchester, VA, United States- Apple Blossom Mall 1850 Apple Blossom Dr Job ID:1074107 Date:November 12, Read more
    All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.