Automated Benchmarking of Java APIs

: Performance is an extra-functional property of software systems which is often critical for achieving sufficient scalability or efficient resource utilisation. As many applications are built using application programmer interfaces (APIs) of execution platforms and external components, the performance of the used API implementations has a strong impact on the performance of the application itself. Yet the sheer size and complexity of today's APIs make it hard to manually benchmark them, while many semantical constraints and requirements (on method parameters, etc.) make it complicated to automate the creation of API benchmarks. Benchmarking the whole API is necessary since it is in the majority of the cases hard to exactly specify which parts of the API would be used by a given application. Additionally, modern execution platforms such as the Java Virtual Machine perform extensive nondeterministic runtime optimisations, which need to be considered and quantified for realistic ben...

• Type: Conference
• Year: 2010
• Where: SE
• Authors: Michael Kuperberg, Fouad Omri, Ralf Reussner
• Keywords: Execution Platforms, Java Platform API, Java Virtual Machine, SE 2010, Software Engineering