Browser-based Web Browser Testing: Litmus vs. Adobe BrowserLab
Below is a quick comparison of two browser testing tools. There are others out there, feel free to add in comments. However, since Adobe just made another press push for BrowserLab I thought it would be a good time to compare these two tools that I've been trying out.
Litmus
Litmus is out of the UK, and has been around in some capacity since 2005. They currently offer both an HTML-based web application, as well as a nascent desktop application counterpart.
Browsers supported at this time:
- Short answer - Litmus wins here big time with a very broad list of browsers on both Windows and Mac. Full list here.
Stand out features:
- Not just web browser testing, but also Email Testing - a feature Adobe doesn't have at all
- Browser tests can show both: Cropped, in-browser window; and Full page no browser window bordering image
- Save multiple tests
- Retesting / test history, iterative workflow
- Validation warnings and direct links to validation results
- Ability to download test results
- Ability to mark a test as complied and share the results (ie Social features)
- bookmarkelt lets you test any page you are visiting in your normal browser
- Rich Help and other resources
Adobe® BrowserLab
Adobe BrowserLab is in a limited time preview stage, this Flash-in-browser-based tool covers the website basics that Litmus does and has a few slick features. One immediate 'weakness' in comparison is that at the moment you can only run one test at a time and there is no apparent way to access test history.
Browsers supported at this time:
- Firefox 2.0 & 3.0 for both Win XP and Mac OSX
- IE 6.0 & 7.0 for XP
- Safari 3.0 for Mac
Stand out features:
- Views: single browser, 2-up for comparison, and a very cool "Onion Skin View" that overlays two different captures to show where layout diverges.
- Browser sets, with controls
- Zooming on captures
- BrowserLab Extension for Dreamweaver CS4
Verdict
IMO, Litmus offers a broader more user-friendly set of features for testing multiple sites in an iterative fashion. It's huge browser library and additional support for testing HTML Email give it a clear edge. Adobe may be able to catch up of course, but I also feel that it will ultimately come down to pricing. Both offer free options, but at the moment Adobe allows you to test IE 6 for free, whereas Litmus requires a paid plan to gain access to anything but IE 7 and Firefox 2.0. Adobe has not set pricing, but has stated that it will become a paid service after it moves out of preview release. We'll have to see how the pricing packages compare. For the time being, you could benefit by using both in tandem, which I'll likely do for a while until I feel there's reason not to. No matter what, the advent of powerful browser-based browser testing tools is a huge time, money, and headache saver for website builders concerned with providing the best user experience possible across a large spectrum of web clients.
Labels: adobe, browser, design, development, dreamweaver, email, firefox, html, ie, litmus, safari, services, testing, ux, web2.0, website






iLounge.com recently released its 



