Browser-based Web Browser Testing: Litmus vs. Adobe BrowserLab

Below is a quick comparison of two browser testing tools. There are others out there, feel free to add in comments. However, since Adobe just made another press push for BrowserLab I thought it would be a good time to compare these two tools that I've been trying out.

Litmus

Litmus is out of the UK, and has been around in some capacity since 2005. They currently offer both an HTML-based web application, as well as a nascent desktop application counterpart.

Browsers supported at this time:

• Short answer - Litmus wins here big time with a very broad list of browsers on both Windows and Mac. Full list here.

Stand out features:

• Not just web browser testing, but also Email Testing - a feature Adobe doesn't have at all
• Browser tests can show both: Cropped, in-browser window; and Full page no browser window bordering image
• Save multiple tests
• Retesting / test history, iterative workflow
• Validation warnings and direct links to validation results
• Ability to download test results
• Ability to mark a test as complied and share the results (ie Social features)
• bookmarkelt lets you test any page you are visiting in your normal browser
• Rich Help and other resources

Adobe® BrowserLab

Adobe BrowserLab is in a limited time preview stage, this Flash-in-browser-based tool covers the website basics that Litmus does and has a few slick features. One immediate 'weakness' in comparison is that at the moment you can only run one test at a time and there is no apparent way to access test history.

Browsers supported at this time:

• Firefox 2.0 & 3.0 for both Win XP and Mac OSX
• IE 6.0 & 7.0 for XP
• Safari 3.0 for Mac

Stand out features:

• Views: single browser, 2-up for comparison, and a very cool "Onion Skin View" that overlays two different captures to show where layout diverges.
• Browser sets, with controls
• Zooming on captures
• BrowserLab Extension for Dreamweaver CS4

Verdict

IMO, Litmus offers a broader more user-friendly set of features for testing multiple sites in an iterative fashion. It's huge browser library and additional support for testing HTML Email give it a clear edge. Adobe may be able to catch up of course, but I also feel that it will ultimately come down to pricing. Both offer free options, but at the moment Adobe allows you to test IE 6 for free, whereas Litmus requires a paid plan to gain access to anything but IE 7 and Firefox 2.0. Adobe has not set pricing, but has stated that it will become a paid service after it moves out of preview release. We'll have to see how the pricing packages compare. For the time being, you could benefit by using both in tandem, which I'll likely do for a while until I feel there's reason not to. No matter what, the advent of powerful browser-based browser testing tools is a huge time, money, and headache saver for website builders concerned with providing the best user experience possible across a large spectrum of web clients.

Internet Explorer: A Browser Breaks

"Enterprises aren't loving Internet Explorer 7, so how can its successor do any better?...

For businesses looking for a standards-compliant Web browser, Internet Explorer won't be the choice in 2008, with IE 6 entrenched and IE 8's release as much as a year away—or more, if closely aligned with Windows 7. For Web developers, the standards headaches will continue as long as IE 6 enterprise adoption remains high...

There is huge competitive opportunity for Mozilla, and even Apple, to exploit Microsoft's browser problems. Both organizations have highly standards-compliant browsers that can be deployed at lower risk."

Why Browser War 2.0 Will Heat Up in 2007

readwriteweb.com: "Our theory is that in 2006 a lot of the ground work for a major battle was laid out. Microsoft launched a significant upgrade to Internet Explorer for the first time in about 5 years (IE7), while the Firefox team spent time polishing up their open source browser. But it is the latest developments which make it clear that Firefox thinks it's showtime."

This is an interesting article, and I really got a kick out of the illustration. Between the business interests and the (still) inconsistent support for web standards in IE7, it should be another interesting year in the browser-sphere.

Microsoft releases long-awaited Explorer 7

"Microsoft Corp. released Internet Explorer 7 on Wednesday, the first major upgrade to its Web browser since 2001 with new features aimed at preventing online fraud and improving ease of use...

IE 7 is available immediately to Windows XP users and it will eventually serve as the default browser for Microsoft's much-anticipated Windows Vista operating system, due out to consumers in early 2007."

IE 7 is available for download at www.microsoft.com/ie

Let's hope that support for standards in this final release is close to that of Firefox. Unfortunately for designers/developers this more likely means that we'll be testing for IE 5, 6, and now 7 too - at least until Vista ships and the adoption rate for 7 picks up.