TweetFollow Us on Twitter

MacTech Magazine Article Archives

Volume Number: 23 (2007)
Issue Number: 01
Column Tag: Network Administration

Jumbo Frame Networks

Tap into extra Ethernet speed

By Steve Modica

Approximately one year ago, Apple introduced its first dual Ethernet G5 PowerMac. The system sported an internal Broadcom chip that provided the user with two high-speed Gigabit Ethernet ports.

Why would Apple include a second Ethernet port on their new PowerMac systems? One reason (probably the most obvious) is for Xsan support. To add a system to an Xsan storage network (or almost any clustered filesystem network), the system must be connected to the Fibre Channel based storage, its normal internet connection, and a dedicated "Meta-data" network.

On the previous generation of PowerMacs, this would require the customer to purchase an extra Gigabit Ethernet NIC (network interface card), which uses up one PCIX or PCIE slot and requires the user to open up the machine to install the device. When you consider the extra Fibre Channel card (which may have been ordered directly from Apple), you're now down to one free PCI slot to house your high-speed video capture or other application specific devices.

Given the minimal price premium for going to a dual port Gigabit Chip from a single port, adding that second connector was a no-brainer for Apple.

Xsan and clustered filesystems in general, have a lot of promise. Systems can be attached directly to the shared storage using Fibre Channel, and the Ethernet based "meta-data" network is used as the traffic cop. It assures that multiple systems aren't modifying the same filesystem structures simultaneously.

The problem with these new filesystem technologies is the entry point cost. Purchasing an Apple XRAID is quite economical given their cost per byte ratio (one of the lowest in the industry), but when you add in the cost of a Fibre Channel switch, Fibre Channel adapters for each machine, additional Ethernet ports for the meta-data network and the software licenses, the cost begins to approach $30,000 for even the smallest network. When compared to even high-end NAS storage devices, the choice is easy.

So assuming you are one of the many 5-10 system shops that simply can't justify a $30,000 entry point for storage, but you've paid for all of these great PowerMac and Mac Pro systems with second Gigabit Ethernet ports, what can you do to take advantage of them? There's nothing worse than buying something and leaving it sit idle, especially when shared network performance is one of the most common complaints at small shops.

One very common use of these extra ports is to create a dedicated storage network that uses Gigabit Ethernet's built-in "jumbo frame" technology to speed up the transfer of data, while reducing the amount of cpu overhead created when transferring that data.

A configuration like this can significantly improve network performance for file-transfers, captures and downloads, while freeing the "normal" office network for things like email, web browsing and DHCP services. This setup will also increase the amount of CPU cycles available on the server and the clients for local image processing -- a big win for everyone in the office.

What are Jumbo Frames? Seven years ago, when Gigabit Ethernet was just becoming available, processors were a lot slower than they are today. Vendors weren't crowing about how many Ghz their systems were clocked at. They were still working on hitting the 1Ghz mark! These new "high-speed" Gigabit adapters were expensive and quirky. Finding adapters (which typically ran $1500 or more) that worked with all your platforms and a switch that worked with all your adapters was no small task.

During this period, a typical Gigabit Ethernet adapter would easily eat up an entire CPU just for interrupt processing. It was rare to see a Gigabit adapter perform at "line rate" (IE 1 Gb). More typically, adapters would get between 400 and 600Mbits/sec. This is still plenty good, but it must be remembered that while maintaining these rates, your machine wasn't doing anything else.

Enter the notion of "Jumbo Frames"

Ethernet (and all of its add-on features) are defined as IEEE 802.3. This spec includes things like auto-negotiation, link aggregation, 10MbEthernet, 100Mb/Ethernet and even 10Gb/Ethernet. The spec defines the size of an Ethernet frame as 1500 bytes -- typically somewhere between 1488 and 1514 bytes depending on the platform.

Receiving 1 billion bits of data adds up to 83,333 packets per second. Theoretically, each one of these packets requires the CPU to stop what its doing, receive the packet from the Gigabit card, process the headers, and provide the data to the waiting application (you).

At 83,333 packets per second, most of the CPUs time is spent context switching. It's constantly saving and recalling what it was doing just prior to processing your last packet. No real work is getting done.

Vendors quickly realized that unless they wanted to wait for processor and bus speeds to catch up, they wouldn't sell many cards. They needed a solution that would allow their products to work on the slower processors available at that time. Jumbo frames provided one such solution.

Rather than moving data in 1500 byte chunks, they allowed their cards to use much larger packets. Some vendors supported 16384 bytes, others supported smaller numbers. The "de facto" standard was 9000 bytes.

At 9000 bytes per frame, the packet processing load is reduced by a factor of 6 (13,888 packets per second). The CPU has 1/6th the number of headers to process and theoretically, 1/6th the number of interrupts to handle.

Today, all but the very cheapest switches support jumbo frames and switch ports for Gigabit are well under $100 per port. This makes it extremely easy and economical to create a dedicated jumbo frame network.

Benefits

1. Having a separate network means less bandwidth contention for critical operations like captures or online editing.

2. Jumbo frames allow local systems to have more CPU cycles available for things like Final Cut Pro, improving the users experience running the application.

3. A jumbo frame network can support a larger class of systems including Apple Macbook, Macbook Pros, Mac Minis and iMacs.

4. Jumbo frames can be used to access "storage over Ethernet" devices like iSCSI and AoE RAIDS, such as those designed by companies like 2 Degrees Frost. These products eliminate typical bottlenecks found in client/server networks.

Conclusion

Having extra Gigabit ports on your machines makes using jumbo frames easier than ever and the benefits are tremendous. All small video capture and post houses, audio and pre-press shops should consider this simple, elegant solution to improve their network without breaking the bank.


Steve Modica is the Chief Technical Officer of Small Tree Communications. Mr. Modica brings over 15 years of experience in the field of high performance operating systems to the company. Prior to founding STC, he worked at Silicon Graphics Inc. managing a group of device driver engineers and managing third party vendor relationships. For the four years prior to joining SGI, he owned and operated HPC Consulting; a company specialized in customizing corporate networks. Mr. Modica attended Wayne State University in Detroit on a Merit Scholarship and received his degree in Electrical Engineering in 1992.

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

VMware Fusion 11.5.6 - Run Windows apps...
VMware Fusion and Fusion Pro - virtualization software for running Windows, Linux, and other systems on a Mac without rebooting. The latest version includes full support for Windows 10, macOS Mojave... Read more
Alfred 4.1 - Quick launcher for apps and...
Alfred is an award-winning productivity application for OS X. Alfred saves you time when you search for files online or on your Mac. Be more productive with hotkeys, keywords, and file actions at... Read more
Dashlane 6.2032.0 - Password manager and...
Dashlane is an award-winning service that revolutionizes the online experience by replacing the drudgery of everyday transactional processes with convenient, automated simplicity - in other words,... Read more
Skype 8.63.0.76 - Voice-over-internet ph...
Skype is a telecommunications app that provides HD video calls, instant messaging, calling to any phone number or landline, and Skype for Business for productive cooperation on the projects. This... Read more
Mellel 5.0.3 - The word processor for sc...
Mellel is the leading word processor for OS X and has been widely considered the industry standard for long form documents since its inception. Mellel focuses on writers and scholars for technical... Read more
A Better Finder Rename 11.20 - File, pho...
A Better Finder Rename is the most complete renaming solution available on the market today. That's why, since 1996, tens of thousands of hobbyists, professionals and businesses depend on A Better... Read more
TunnelBear 3.9.10 - Subscription-based p...
TunnelBear is a subscription-based virtual private network (VPN) service and companion app, enabling you to browse the internet privately and securely. Features Browse privately - Secure your data... Read more
Dropbox 103.4.383 - Cloud backup and syn...
Dropbox for Mac is a file hosting service that provides cloud storage, file synchronization, personal cloud, and client software. It is a modern workspace that allows you to get to all of your files... Read more
Daylite 2020.29.1 - Dynamic business org...
Daylite helps businesses organize themselves with tools such as shared calendars, contacts, tasks, projects, notes, and more. Enable easy collaboration with features such as task and project... Read more
HoudahSpot 5.1.5 - Advanced file-search...
HoudahSpot is a versatile desktop search tool. Use HoudahSpot to locate hard-to-find files and keep frequently used files within reach. HoudahSpot will immediately feel familiar. It works just the... Read more

Latest Forum Discussions

See All

Motorball is a car football game from No...
A few years back Noodlecake Studios announced that they would be dipping in the multiplayer gaming realm with two different games. The first of those, Golf Blitz, released a while back and has proven to be very popular. Now, the second has arrived... | Read more »
SINoALICE's latest update introduce...
SINoALICE's latest update has now arrived, adding several fan-favourite characters from popular RPG series NieR. Young Nier, Kaine, and Young Emil are available in-game as part of a limited-time crossover event set to run until August 20th. [Read... | Read more »
Rocat Jumpurr is an intense roguelite pl...
Rocat Jumpurr is a roguelite platformer from developer Mousetrap Games. You might already be familiar with it if you follow the Big Indie Pitch, where it won first place during this year's Pocket Gamer Connects London competition. Following its... | Read more »
PUBG Mobile's Play As One campaign...
Back in mid-July, we reported that PUGB Mobile had teamed up with Direct Relief to help raise money for the charity's COVID-19 response project. It focused on an in-game running challenge for players, which lead to the PUBG Mobile donating $2... | Read more »
Marvel Contest of Champions' latest...
Marvel Contest of Champions' latest motion comic has arrived, and it shows off new fighters Air-Walker and Dragon Man. Both characters are set to arrive in-game this month. [Read more] | Read more »
Clash Royale: The Road to Legendary Aren...
Supercell recently celebrated its 10th anniversary and their best title, Clash Royale, is as good as it's ever been. Even for lapsed players, returning to the game is as easy as can be. If you want to join us in picking the game back up, we've put... | Read more »
Global Spy is an intriguing 2D spy sim f...
Developer Yuyosoft Innovations' Global Spy launched last month for iOS and Android, though if you missed it at the time, we're here to tell you why it's well worth a go. This one's all about international espionage, tracking down elusive spies,... | Read more »
Distract Yourself With These Great Mobil...
There’s a lot going on right now, and I don’t really feel like trying to write some kind of pithy intro for it. All I’ll say is lots of people have been coming together and helping each other in small ways, and I’m choosing to focus on that as I... | Read more »
Hyena Squad is sci-fi turn-based strateg...
Wave Light Games has just revealed its latest release, Hyena Squad, a turn-based RPG set in a space station infested by gross aliens and the living dead. The announcement was first reported on by Touch Arcade. [Read more] | Read more »
Idle Guardians: Never Die is a pixel art...
SuperPlanet has been fairly prolific with game releases so far this year with both Evil Hunter Tycoon and Lucid Adventure releasing earlier this year. Now, they've released another idle RPG called Idle Guardians: Never Die, which you can download... | Read more »

Price Scanner via MacPrices.net

Apple restocks refurbished 2020 13″ MacBook A...
Apple has restocked Certified Refurbished 2020 13″ MacBook Airs starting at only $849 and up to $200 off the cost of new Airs. Each MacBook features a new outer case, comes with a standard Apple one-... Read more
Apple restocks clearance 2019 13″ 2.4GHz MacB...
Apple has restocked Certified Refurbished 2019 13″ 2.4GHz 4-Core Touch Bar MacBook Pros starting at $1359 and up to $560 off original MSRP. Apple’s one-year warranty is included, shipping is free,... Read more
Apple restocks refurbished iPhone XR models s...
Apple has restocked Certified Refurbished, unlocked, iPhone XR models in the refurbished section of their online store starting at $539. Each iPhone comes with Apple’s standard one-year warranty,... Read more
Price drops! $100-$200 off clearance 27″ 5K i...
B&H Photo has dropped prices on clearance, previous-generation 27″ 5K iMacs by up to $200 off Apple’s original MSRP: – 27″ 3.0GHz 6-Core 5K iMac: $1699 $100 off original MSRP – 27″ 3.1GHz 6-Core... Read more
Woot offers Apple Watch and iPhone models fro...
Amazon-owned Woot has refurbished Apple Watch and iPhone models available from $99-$749 through August 6th. According to Woot, the items may show some wear, but they have all been fully tested and... Read more
Apple’s Phil Schiller Steps Down As SVP OF Wo...
NEWS: 08.05.20 – Former Apple senior Vice President of worldwide marketing, Phil Schiller, is stepping down from his long time role at the company in order to focus on spending more time with family... Read more
Expercom offers $320 discount on the 6-core 1...
Apple reseller Expercom has the Silver 16″ 6-core MacBook Pro on sale for a limited time for $2079 shipped. Their price is $320 off Apple’s MSRP for this model, and it’s the cheapest price currently... Read more
Apple announces Education pricing for new 202...
Purchase a new 2020 iMac or iMac Pro at Apple using Apple’s Education discount, and take up to $400 off MSRP. All teachers, students, and staff of any educational institution with a .edu email... Read more
Apple reseller Expercom offers $256 discount...
Expercom has Apple’s new 2020 10-core iMac Pro available for order and on sale for $4743 shipped. Their price is $256 off Apple’s MSRP for this new model, and it’s the cheapest price we’ve seen so... Read more
Apple releases refreshed 2020 27″ iMacs with...
Apple today released updated versions of their 27″ iMacs featuring 10th generation Intel processors, SSDs across the board, a better 5K display, and improvements to the camera, speakers, and mic.... Read more

Jobs Board

Executive Team Leader GM Sales (Assistant Man...
…(Assistant Manager General Merchandise and Operations) - Apple Valley, CaliforniaApply NowJob ID:R0000082364job family:Store Managementschedule:Full Read more
Cub Foods - *Apple* Valley - Now Hiring Par...
Cub Foods - Apple Valley - Now Hiring Part Time! United States of America, Minnesota, Apple Valley New Retail Post Date 2 days ago Requisition # 122305 Sign Up Read more
Part-time Geek Squad *Apple* Consultation P...
**770829BR** **Job Title:** Part-time Geek Squad Apple Consultation Professional-Store 384(Ithaca) **Job Category:** Store Associates **Store Number or Department:** Read more
Product Manager, *Apple* Commercial Sales -...
Product Manager, Apple Commercial Sales Austin, TX, US Requisition Number:77652 As an Apple Product Manager for the Commercial Sales team at Insight, you Read more
Cub Foods - *Apple* Valley - Now Hiring Par...
Cub Foods - Apple Valley - Now Hiring Part Time! United States of America, Minnesota, Apple Valley New Retail Post Date 1 day ago Requisition # 122305 Sign Up Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.