Over the last five years the VLSI Placement community achieved great strides in the understanding of placement problems, developed new high-performance algorithms, and achieved impressive empirical results. These advances have been supported by nontrivial benchmarking infrastructure, and future achievements are set to draw on benchmarking as well. In this paper we review motivations for benchmarking, especially for commercial EDA, analyze available benchmarks, and point out major pitfalls in benchmarking. We outline major outstanding problems and discuss the future of placement benchmarking. Furthermore, we attempt to extrapolate our experience to circuit layout tasks beyond placement. Categories and Subject Descriptors B.7.2 INTEGRATED CIRCUITS / Design Aids C.5.4 VLSI Systems J.6 Computer-aided design (CAD). General Terms Algorithms, Measurement, Documentation, Performance, Experimentation, Human Factors, Standardization. Keywords Layout, Placement, Placer, Benchmark, Performance, ...
Saurabh N. Adya, Mehmet Can Yildiz, Igor L. Markov