Showing posts with label metageek. Show all posts
Showing posts with label metageek. Show all posts

Tuesday, April 9, 2013

First Look - 802.11ac Gigabit Wi-Fi Speed

I just couldn't wait for 802.11ac enterprise WLAN gear to be released, so I went and picked up a consumer router and USB adapter to get a first look at 802.11ac.

Equipment
I picked up the ASUS RT-AC66U and corresponding ASUS USB-AC53 adapter. I decided to go this route because with pre-standard equipment we've historically seen best performance when pairing the AP and client adapters from the same manufacturer.

ASUS 802.11ac Product Lineup

The router supports 3x3:3 MIMO with 80 MHz channels and 256-QAM on the 5GHz 802.11ac capable radio. This results in a raw Wi-Fi data rate capable of 1.3 Gbps. You might want to reference this 802.11ac data rate chart.

The USB adapter on the other hand is a bit handicapped, supporting only 2x2:2 MIMO, 80 MHz channels, and 256-QAM. This results in a raw Wi-Fi data rate capable of 867 Mbps. However, actual throughput performance is further limited by it's USB 2.0 interface which has a raw bus speed of 480Mbps but is limited to somewhere around 60% of that due to USB host controller overhead. So realistically, with this USB adapter I'm going to max out around 288 Mbps of actual throughput. Additionally, it's increasingly hard to pack a 3x3:3 MIMO antenna system into an external USB adapter due to physical size constraints. This is what we've seen with external 802.11n adapters for the most part, and that has continued to be the case with most first-generation external 802.11ac client adapters. We should see more spatial stream support on internal Wi-Fi adapters where the antenna can be integrated into the laptop case in order to create sufficient physical separation.

I loaded the adapter driver and utility into a Windows 7 laptop and it reported the raw speed as 866.5 Mbps, which is equivalent to the adapter's maximum raw Wi-Fi speed based on its specifications.

Windows Connection Details Reported an 866.5 Mbps Speed

Peak Performance
I decided to initially perform a simple file transfer using SMB. To accomplish this, I hooked one laptop to the wired Gigabit Ethernet LAN port on the router as the server and connected the second laptop to the 5 GHz Wi-Fi radio as the client. I pulled a 1.38GB file down from the server to the client over the wireless link. I performed this test over 10 times for reproducibility. The router was configured for 5 GHZ operation with an 80 MHz channel and a primary channel of 48.

File size: 1.38GB / 1,490,209,655 Bytes / 11,921,677,240 bits
Transfer time: 51.0 seconds (avg.)
Application throughput: 233.76 Mbps

Note - remember that this is application layer throughput, which does not include SMB, TCP, IP, or MAC layer overhead.

Next, I performed an iPerf TCP throughput transfer for 60 seconds, modifying the TCP window size to 1024KB. The test was performed ten times, with the average result clocking in at 204 Mbps.

iperf -f m -i 1 -w 1024K -c 192.168.1.33 -t 60

[ ID] Interval       Transfer     Bandwidth
[156]  0.0-60.0 sec  1482 MBytes   204 Mbits/sec

Overall, I was fairly pleased with this result. Although it is nowhere near the Gigabit speeds that 802.11ac is capable of achieving, this is to be expected given the handicapped USB 2.0 adapter that I am using. Given a raw data rate of 867 Mbps peak, I would expect to see throughput around 520 Mbps without the USB 2.0 limitation (or roughly 60% of the peak data rate).

I used MetaGeek's Chanalyzer Pro and WiSpy DBx to record the 80 MHz file transfers. I configured the router to use an 80 MHz channel width, with a primary channel of 48 in the UNII-1 band. The spectrum analysis workstation was located within 5 feet of the router.

Spectrum Analysis of an 802.11ac 80 MHz Channel
You can clearly see FFT waveform across the entire UNII-1 band due to the automatic extension of the primary 20 MHz channel up to the maximum 80 MHz channel width that was configured. As a recap of how the primary and extension channels work, you might want to review my previous post on 802.11ac Channel Planning.

Performance Comparison versus 802.11n
To assess how well the 2 spatial stream 802.11ac client performed, I decided to benchmark it against similarly capable 2SS 802.11n clients. To make the test apples-to-apples, I also turned down the channel width on the ASUS router to 40 MHz, since that is the largest channel width the 802.11n clients support.

I ran the same SMB file transfer test as described previously. The SMB file transfer was run three times for each client and I averaged the results. Each client was placed in the same physical location, approximately 10 feet from the router to assess peak performance.

40 MHz throughput comparison against two different 2x2:2 802.11n clients:

Wi-Fi AdapterWi-Fi CapabilitiesMax Wi-Fi Data Rate at 40 MHzSMB File Transfer TimeSMB Throughput
MacBook Air Airport (Internal)802.11n, 2x2:2 MIMO300 Mbps1:36.7 sec123.29 Mbps
Intel 4965ABGN (Internal)802.11n, 2x2:2 MIMO300 Mbps1:15.5 sec157.90 Mbps
Asus USB-AC53802.11ac, 2x2:2 MIMO400 Mbps
(limited further due to USB 2.0 bus speed)
1:07.0 sec177.94 Mbps

Clearly, the peak performance test shows that the 802.11ac client has an edge due to the higher data rates provided at the top-end with 256-QAM modulation.

Rate over Range versus 802.11n
The aggressive 256-QAM modulation may provide higher peak throughput when a client is physically very close to the AP. But will that advantage hold up over larger distances? There has been significant discussion in the industry about the real-world usefulness of 256-QAM, especially at typical client distances of 10-20 feet or greater from an AP. Will clients realistically be able to use such aggressive modulation in practice?

However, the question about the use of higher modulation is not the only one. Newer wireless chipsets should also benefit from better manufacturing processes that improve 802.11ac client receive sensitivity, translating into the use of higher data rates at at any given distance when compared to older 802.11n clients. Put another way, does 802.11ac exhibit better rate-over-range compared to 802.11n?

For the rate-over-range testing, I ran the same iPerf TCP throughput test as described previously, using a 40 MHz channel width at varying distances from the router. The tests were performed in a residential house since that is the only space that I have available at the moment.

- Point #1: 10 feet from the router, 1 wood panel wall in-between
- Point #2: 25 feet from the router, 1 wood panel wall in-between
- Point #3: 30 feet from the router, 1 wood floor and 1 drywall in-between
- Point #4: 40 feet from the router, 2 wood floors and 1 wood panel wall in-between

Additionally, in parenthesis I provide a rough signal strength and data rate used during the tests as reported by the client supplicant/driver. I also provided the test results for the 802.11ac client using an 80 MHz channel width for reference.

LocationMacbook Air 
(40 MHz)
Intel 4965ABGN 
(40 MHz)
ASUS USB-AC53 
(40 MHz)
ASUS USB-AC53 
(80 MHz)
Point 1154 Mbps
(-50 dBm, 300 Mbps)
165 Mbps
(-50 dBm, 300 Mbps)
204 Mbps 
(-40 dBm, 400 Mbps)
204 Mbps 
(-40 dBm, 867 Mbps)
Point 2144 Mbps
(-60 dBm, 216 Mbps)
150 Mbps
(-60 dBm, 270 Mbps)
180 Mbps 
(-52 dBm, 400 and 324 Mbps)
202 Mbps 
(-54 dBm, 702 and 585 Mbps)
Point 3112 Mbps
(-65 dBm, 162 Mbps)
102 Mbps
(-70 dBm, 180 Mbps)
144 Mbps 
(-54 dBm, 243 Mbps)
201 Mbps 
(-60 dBm, 526 Mbps)
Point 435 Mbps
(-80 dBm, 54 Mbps)
61 Mbps
(-80 dBm, 120 Mbps)
119 Mbps 
(-65 dBm, 216 Mbps)
190 Mbps 
(-70 dBm, 468 Mbps)

The 802.11ac client performance beats both 802.11n clients in all tests at all locations. Additionally, the performance gap widens significantly at Point #4, the farthest distance and weakest signal from the router. Clearly, 802.11ac provides significant rate-over-range improvements over 802.11n.

Performance improvement at each location:
- Point #1: 32.5% (vs MBA), 23.6% (vs Intel)
- Point #2: 25.0% (vs MBA), 20.0% (vs Intel)
- Point #3: 28.6% (vs MBA), 41.2% (vs Intel)
- Point #4: 240% (vs MBA), 95.1% (vs Intel)

The peak performance improvement at Point #1 (32.5%, 23.6%) is squarely in-line with 802.11ac's 33% theoretical improvement over 802.11n due to the higher modulation rate of 256-QAM (400 Mbps) versus 64-QAM (300 Mbps).

The receive sensitivity of the 802.11ac client is also better than the 802.11n clients. At most test locations the 11ac adapter exhibited an 8-15 dB signal advantage over the older 11n adapters. This highlights the fact that newer wireless chipsets offer improved hardware quality over older chipsets. Receive sensitivity also appears to be better for the same 802.11ac adapter when smaller channel widths are used. This highlights the fact that as channel width increases, clients will need to maintain a slightly better signal strength to maintain the same modulation rate. In practice, this will mean there is a slight trade-off with decreased modulation rate when increasing channel width, while maintaining all other variables constant (such as transmit power, antenna gain, etc).

To answer the questions surrounding the use of 256-QAM at distances greater than 10-20 feet, I've found that the usable distance and signal strength required to use 256-QAM data rates is around 25-30 feet (in my case with one light wall in-between) and around -52 dBm signal strength. I note multiple data rates being used for the 802.11ac client at Point #2 because the client appeared to be data rate shifting during the test, likely unable to sustain 256-QAM modulation at times and shifting to a lower rate. These values are almost certain to vary between client adapters based on receive sensitivity, but this should provide a rough estimate for WLAN administrators.

Results Recap

Let's add up the 802.11ac test results:
  1. Decent peak performance at 80 MHz channel width, although it we should see double this performance with integrated adapters or USB 3.0 external adapters.
  2. Better peak performance than 802.11n at comparable 40 MHz channel width due to the use of more aggressive 256-QAM at relatively close distances to the AP.
  3. Better rate-over-range performance than 802.11n, especially as distance from the AP increases and signal level deteriorates.

Final Thoughts
It was great to get a first-look at 802.11ac equipment, even though the currently available client adapters are a bit disappointing from a peak performance standpoint due to their reliance on USB 2.0 bus speed. You might consider waiting for integrated 802.11ac client adapters or external USB 3.0 adapters to hit the market, which should be capable of supporting the full throughput that 802.11ac offers. A few are already out there; I found this 802.11ac hardware wiki that seems to be keeping track of consumer equipment.

Even though you might not see awe-inspiring peak performance for any single client with this early release equipment, 802.11ac still stands to improve the aggregate performance and capacity of the network through more efficient use of airtime. WLAN administrators should expect to see this aggregate increase in network capacity even with 802.11ac capable mobile devices such as tablets and smartphones. Since they will be using higher Wi-Fi data rates, they will be getting on and off the air quicker for a given application throughput level than they would by using 802.11a/g/n. This will translate into the ability to support more clients or higher throughput per-client, and will be a big boost for enterprise WLAN capacity!

Cheers,
Andrew


Read the Entire 802.11ac Gigabit Wi-Fi Series:


Friday, March 25, 2011

Wireless Tech Field Day Article Round-Up

Here is a round-up of the Wireless Tech Field day articles written about the event by both delegates and sponsors.

Additional links to videos, photos, podcasts, and event articles can also be found on the official Gestalt IT Tech Field Day page for this event.

It truly was an amazing experience to be a part of the group. So much wireless brain power in one room was amazing! Special thanks go to Stephen and Claire for organizing the event, and pulling it off without a hitch. Thank you to all of the sponsors as well for sharing product roadmaps and providing engaging demonstrations and discussions.

A large part of the event was engaging the larger wireless community through blogs and twitter. Thank you to everyone who participated on the Internet, your input and discussion was appreciated!

Delegate Articles:
Sponsor Articles:
Presentation Videos:
  • Stephen Foskett Welcomes the community to the event.
  • Several delegates and vendors provide a Day 1 Event Wrap-Up. Go ahead and laugh at my portion (I am!), that light was really bright!
  • Aerohive presentations from the event have been posted. Go check them out!

Cheers,
Andrew

P.S. - When is the next one? Sign me up NOW!

Wireless Tech Field Day - MetaGeek Spectrum Analysis

MetaGeek was the first presenter at Wireless Tech Field Day and kicked off the event with a superb presentation and demonstration of their flagship products, the Wi-Spy DBx and Chanalyzer Pro.

The MetaGeek Wi-Spy family of wireless spectrum analysis adapters offers Wi-Fi engineers a workstation-based wireless physical layer analysis solution at a much lower cost than competitive products such as Cisco Spectrum Expert or AirMagnet Spectrum XT.

A Culture of Innovation
Ryan and Trent started off the presentation describing MetaGeek's roots as a company. Back in 2005, Ryan worked as a wireless protocol developer for semi-conductor company that manufactured parts for wireless mice. The company began experiencing problems with 2.4GHz mice not working properly, and narrowed the problem down to times when large amounts of Wi-Fi transfers were occurring. Ryan was dispatched to Japan to work with partners to resolve the issue.

As any IT engineers is well aware, the first step in troubleshooting is to accurately replicate the issue on-demand. At first, an intern was assigned the task of repetitively drawing circles with the mouse for data collection (poor schmuck!). And the cost of an industrial automated mouse tester proved prohibitive. However, Ryan developed a more elegant solution to automate the process using an unconventional technique that geeks will especially enjoy: Legos!
Lego Mouse Tester
The Lego mouse tester (it's official name) was controlled by a Lego RCX unit to provide variable speed and timed tests. The mouse tester allowed the company to accurately replicate the issue and provide a volume of data necessary to identify the interference issue, quantify impact, and develop a resolution. What's more important, is the experience got Ryan thinking about how to create an effective spectrum analyzer to observe and quantify the source of the problem, the RF environment. Thus, the first Wi-Spy adapter was born from the modification of a wireless mouse dongle!

MetaGeek still provides employees with 20% time to work on side-projects and keep innovation alive (as they have time and time again over the last 5 years)!

Product Features
The Wi-Spy adapter family and Chanalyzer software have evolved over time to provide a feature-rich spectrum analysis solution for inexperienced and "multi-hat" administrators, as well as professional wireless engineers. The Chanalyzer software's main display provides core RF information in the density and waterfall graphs, with additional relevant information such as duty cycle, networks, and channel data in tables in the lower pane.

Chanalyzer Density Graph
The best feature of the product, without a doubt, is the density graph (displayed above). This density graph shows similar data to the real-time fast fourier transmission (FFT) of other products by displaying RF data in an amplitude over frequency format. However, the RF energy is color-coded either by density (the collective amount of energy at specific points over time) or by amplitude (the energy intensity). This really make RF signal patterns "pop" as data is collected over time, allowing much easier pattern recognition by the user. This is what makes the tool simple and intuitive for users inexperienced in RF spectrum analysis. MetaGeek pioneered the use of the density view in 2007, and has since been adopted by AirMagnet (but not Cisco/Cognio). I still find MetaGeek's implementation the best.

Chanalyzer Pro
Timescale
Another great feature of the product is time segment analysis using the waterfall timescale panel on the left in Chanalyzer Pro (shown left). This allows the user to capture, pause, and rewind spectrum data to isolate and review potential issues. Additionally, the configurable time span being viewed allows the user to focus in as narrowly or broadly as required to pinpoint the pattern requiring further analysis. Spectral anomalies can easily be identified in the timescale, and hovering over a section presents a preview of the density graph at that point in time. Time segment analysis unifies the data in all other graphs and tables for complete replay capability. The feature is invaluable when performing spectrum surveys or for remote analysis by an expert after the issue has occurred. Competitive products also offer time segment analysis, but not as intuitively or comprehensively as Chanalzyer Pro in my opinion, offering recording and playback but not timescale previews that allow the user to quickly navigate to the point in time of most interest.


Chanalyzer Pro includes numerous other features, such as a report builder, device signature overlays, Wi-Fi network identification and overlays, and channel statistics.

Product Previews
To wrap up their presentation, MetaGeek showed us advanced previews of a few products and features they are actively working on. This provided the delegates opportunity to provide insights into how they use spectrum analysis products and desired features.

Ryan showed a live prototype of an iPad application for playback of recorded spectrum captures, which was a hit with the delegates to be sure! The need for portable Wi-Fi tools is always top of mind for wireless engineers, and MetaGeek has their sights on targeting that need in their products.

Ryan (right) and Trent (left) preview iPad integration

Other previews included work being performed on directional antenna prototypes for device locationing (similar to the current Device Finder antenna they offer), and remote spectrum sensors embedded in Pogoplug units. This will allow remote monitoring of spectrum at distributed offices, or on-demand shipment of a spectrum analysis solution to sites and installation by on-site personnel with minimal training involved. This reduces travel expenses for organizations to resolve wireless interference issues when expert staff is centrally located. Coupled with on-board storage and a remote access to the unit, this solution could be a killer feature for medium and large organizations.

Revolution or Evolution? - Andrew's Take
MetaGeek is a clear innovator in spectrum analysis. The company is focused on product differentiation and aggressively developing features to meet customer needs. What's more, the product provides comparable capabilities, and even better in many instances, than higher priced alternatives. The Wi-Spy is a great tool for both the inexperienced as well as the professional wireless engineer.

What also excites me about MetaGeek as a company is their solid grasp of customer requirements and a simple yet powerful user experience. Ryan, Trent, and team really listen to customer feedback and use it to drive product direction that makes sense for the company and remains relevant for users.

The Chanalyzer software does have a few gaps that should be noted. MetaGeek does not provide an in-house wireless site survey solution, but partner to integrate Wi-Spy into the VisiWave tool to map interference. Also, device identification has been a feature in flux for the company. They have created a large community forum for users to upload and share device signatures, and have integrated a few verified signatures into the Chanalyzer software. However, automatic device identification is not available; users must manually correlate observed RF patterns to the signatures.

MetaGeek also offers InSSIDer for Wi-Fi network discovery, Device Finder for interferer location via a directional antenna, and GPS integration with Google Earth maps.

Cheers,
Andrew

Other Posts You Might Like:

Friday, March 18, 2011

Wireless Tech Field Day - Day 1 Recap (MetaGeek, Cisco, Aerohive)

Ryan Woodings and Trent Cutler from MetaGeek,
presenting at Wireless Tech Field Day
Today started off with MetaGeek presenting their Wi-Spy spectrum analysis product and Chanalyzer Pro software in the morning. Ryan Woodings and Trent Cutler provided a live demo of features in real-time as they presented product features, which was great. Having a look at the topics being covered and a live reference in front of the delegates worked great! Ryan provided a background of the company beginnings, ran the delegates through the product feature set, previewed some features and product enhancement in the pipeline, which were ALL so cool. Every delegate in the room was engaged in the roadmap discussion and excited to see where they were taking the product. Expect to see some amazing innovation coming out of MetaGeek, they’ve got a great sense of the market and product features that customers will want.

Mid-morning, we shipped off to Cisco for presentations on several wireless products. First up, Jim Florwick discussed media rich applications, outlining key success factors for modern mission critical Wi-Fi networks. Next up, David Stiff discussed challenges with spectrum management, the need for integrated spectrum analysis, and Cisco’s CleanAir technology. The bulk of the information was presented in PowerPoint format and did not include any demonstrations, which was a bit unfortunate as the technical delegates seemed more excited throughout the day when seeing features live. The back-to-back spectrum analysis discussions of MetaGeek and Cisco prompted some great comparison points and different use-cases for each technology, which was a recurring discussion theme throughout the day.

After a brief lunch break, David continued the Cisco presentation with information on the MobileAccessVE partner solution for in-building cellular coverage improvement. The solution seems to be a good fit in the U.S. in many urban and rural indoor locations that have poor coverage. The draw for the product is the reduced expense for cellular enhancement by leveraging existing UTP Cat5e/6 cable plant instead of distributed antennas systems (DAS) or overlay cellular infrastructure. However, the need for the MobileAccess controllers and access pods to be in-line between the AP and LAN switch limits the cost-effectiveness to small installations with minimal IDF closets. The duplication of the controller hardware in multiple IDFs can quickly become cost-prohibitive.

The next Cisco presentation focused on next generation hotspots by David Stephenson, an engineer that helped write the IEEE 802.11u amendment. An engineer at heart, you could tell David was passionate about the solution and had a lot of pride in ownership of the capabilities being brought to market by Cisco Service Provider Wi-Fi. The need for secure hotspots and improved user experience is clear, and 11u will initially enable cellular carriers and independent hotspot operators to offer seamless roaming from cell to Wi-Fi. Unfortunately, not much work has been done to accommodate non-carrier hotspots, which is my opinion is the bigger market segment. I was able to ask about secure anonymous hotspot authentication, but it appears that not much is being done to directly address these networks outside of the hope for Wi-Fi Alliance extensions to 802.11u or continued IETF work on EAP protocols. I am really dis-heartened by this news, as it is my firm belief that guest Wi-Fi in hospitality, retail, and many other verticals has become a basic commodity service that is free for customers in most cases (at-least in the U.S.) and required to stay competitive in the market. The need for ease-of-use for layer 2 security on these hotspots is a huge untapped potential.

Finally, Jameson Blandford provided a brief overview of some 802.11n technology after the live stream was cut. Most of this discussion was confidential analysis information and I won’t be able to write much more about the topics covered.

Aerohive was the final presenter for day 1. There is only one word to describe the session at the Aerohive offices, “amped”! We received a surprise visit from Bob O’Hara (yes, the Bob O’Hara!), who enlightened the delegates on Wi-Fi history of scalability issues and the evolution of the modern wireless controller architecture. His takeaway from that evolutionary phase was particularly insightful. The biggest benefit was not the controller architecture but what it enabled – the transformation of Wi-Fi from a niche product to a mass-market solution. I definitely sensed the pride from Bob in his involvement in this transformation. It must have been truly awesome to be an integral part of a cultural and societal transformation that is now enabled by ubiquitous mobile information access through Wi-Fi. Wow!

Next, Devin Akin shot through the Aerohive product market position and feature set information like a bullet! His technical depth and excitement of the product and innovation being done within the company couldn’t have been more visible. The delegates focused questions on key slides that contained critical product differentiation points.

Paul, Andrew, and Abby then kicked off a serious of ridiculously well-executed product demonstrations! They really kept the delegates engaged showing features live, while managing to throw in some impromptu acting skills. They covered Private Pre-Shared Key (PPSK), TeacherView, Mesh operation, HiveAP Active Directory integration and credential caching (super-cool BTW), Dynamic Network eXtension Protocol (DNXP) for Layer 3 roaming and tunneling between subnets, and failover protocols with layer 2 routing (yes, layer TWO routing). Then Paul performed a complete system factory reset and ground up configuration in under 14 minutes, highlighting the product ease of use and “time to value”.

All in all, a it was a packed, hyped, amped, red-bull energy day. I don’t think I could have asked for more!!!

As a reminder, everyone can follow Wireless Tech Field Day on Twitter using the hashtag #TechFieldDay, following the @TechFieldDay lists for wfd1-delegates and wfd1-sponsors, or by watching the live (and soon to be archived) video streams at http://www.techfieldday.com.

Tune in soon for day 2 activities.

Cheers,
Andrew