We have replicated the experiments of Cecchet et al. detailed in ”Performance and Scalability of EJB Applications” at OOPSLA ’02. We report on our experiences configuring, deploying and tuning Enterprise software. We found a number of configuration problems that suggest that some of the conclusions of the original work were wrong.