"The biggest problem with these [application] servers isn't raw performance," Hablutzel comtinued. "It's that they are becoming increasingly unstable as more and more features are crammed in faster and faster to keep up with this kind of 'do they have feature XXX?' shootout."

Designed by SYS-CON Media and Burton Group to provide main app server vendors with an opportunity to demonstrate the features and capabilities of their products, the shootout moved into its next stage as Burton Group explained how, at SYS-CON Media's invitation, it will be staging the shootout.

There will be  "a particular focus on interoperability, resiliency, security, and ease-of-use in terms of development, deployment, and management," according to a joint SYS-CON/Burton Group statement.

The statement continued:

"All vendors will be given a prior assignment to develop an application supporting desktop, portal, and Web services clients. The application will be based on one of the Web Services Interoperability Organization (WS-I) sample applications.

As part of the live demonstration, the vendors will show WS-I conformance and interoperability among all the systems, and they can demonstrate the tools used to build, deploy, and manage the application and the application code itself. And finally, during the shoot-out, the vendors will be assigned a series of tests that demonstrate the resiliency and flexibility of the environment. The tests will include system failure and recovery, modification of the application's security requirements, and modification of the application's interface. Burton Group will evaluate the tests both quantitatively and qualitatively."

In a comment to the SYS-CON.com Web site, William Awakenings commented that "An important facet of the whole performance game is TCO - what [cost] do the vendors offer the total solution with application servers at?"  

"Does the hardware come free with the server," Awakenings continued, "or does the software come free? Or is it a subscription based model? Does the hardware and software come free, [with] only an agreement to have Consulting Services needing to be made?"

Anne Thomas Manes, vice president and research director at Burton Group, was enthusiastic about the upcoming Shoot-Out. "We are delighted to be tapped to help make this a clear and fair fight," she said. "The application server companies competing can be assured that we will be bringing to this contest Burton Group's characteristic rigor and vigor."

The Shoot-Out  will be staged at Web Services Edge 2005 East at the Hynes Convention Center, February 15-17, 2005. 

As one of the would-be participants commented, "It requires a level playing field for all participating companies." Burton Group, Manes said, is a trusted guarantor of that. "Burton Group's reputation is to a great extent built on keeping far outside the shadow of vendor agendas," she noted.