Browser-based Web Browser Testing: Litmus vs. Adobe BrowserLab

Below is a quick comparison of two browser testing tools. There are others out there, feel free to add in comments. However, since Adobe just made another press push for BrowserLab I thought it would be a good time to compare these two tools that I've been trying out.

Litmus

Litmus is out of the UK, and has been around in some capacity since 2005. They currently offer both an HTML-based web application, as well as a nascent desktop application counterpart.

Browsers supported at this time:

• Short answer - Litmus wins here big time with a very broad list of browsers on both Windows and Mac. Full list here.

Stand out features:

• Not just web browser testing, but also Email Testing - a feature Adobe doesn't have at all
• Browser tests can show both: Cropped, in-browser window; and Full page no browser window bordering image
• Save multiple tests
• Retesting / test history, iterative workflow
• Validation warnings and direct links to validation results
• Ability to download test results
• Ability to mark a test as complied and share the results (ie Social features)
• bookmarkelt lets you test any page you are visiting in your normal browser
• Rich Help and other resources

Adobe® BrowserLab

Adobe BrowserLab is in a limited time preview stage, this Flash-in-browser-based tool covers the website basics that Litmus does and has a few slick features. One immediate 'weakness' in comparison is that at the moment you can only run one test at a time and there is no apparent way to access test history.

Browsers supported at this time:

• Firefox 2.0 & 3.0 for both Win XP and Mac OSX
• IE 6.0 & 7.0 for XP
• Safari 3.0 for Mac

Stand out features:

• Views: single browser, 2-up for comparison, and a very cool "Onion Skin View" that overlays two different captures to show where layout diverges.
• Browser sets, with controls
• Zooming on captures
• BrowserLab Extension for Dreamweaver CS4

Verdict

IMO, Litmus offers a broader more user-friendly set of features for testing multiple sites in an iterative fashion. It's huge browser library and additional support for testing HTML Email give it a clear edge. Adobe may be able to catch up of course, but I also feel that it will ultimately come down to pricing. Both offer free options, but at the moment Adobe allows you to test IE 6 for free, whereas Litmus requires a paid plan to gain access to anything but IE 7 and Firefox 2.0. Adobe has not set pricing, but has stated that it will become a paid service after it moves out of preview release. We'll have to see how the pricing packages compare. For the time being, you could benefit by using both in tandem, which I'll likely do for a while until I feel there's reason not to. No matter what, the advent of powerful browser-based browser testing tools is a huge time, money, and headache saver for website builders concerned with providing the best user experience possible across a large spectrum of web clients.

Apple posts "MobileMe Setup" instructions page

Apple has posted a page with instructions for setting up (or transitioning) to their MobileMe service that officially launches today. Configurations outlined include:

• iPhone/iPod touch + Mac - Requires iPhone 2.0 Software Update (available July 11).
  
• iPhone/iPod touch + PC - Requires iPhone 2.0 Software Update (available July 11).
  
• Mac setup - Set up just your Mac.
  
• PC setup - Set up just your PC.
  

It's still early in the switch over, so not all aspects of me.com appear to be available yet. The other note on this page states "To access your email from the web, go to www.me.com."

Finally! - Email Standards Project

Email Standards Project: "The Email Standards Project works with email client developers and the design community to improve web standards support and accessibility in email."

I'm very happy to see an organized attempt to address the issue of poor and inconsistent industry-wide support for rich email (html email). The Email Standards Project looks like the bandwagon to jump on. The site has a great chart right on the homepage showing popular email clients (desktop and web-based) and their rating in terms of standards support. The project has come up with an "acid test", much like the Web Standards Project, that is used to fairly and consistently test the ability of a given email client.

Check out the site, join the email list or spread the word.