Please use this identifier to cite or link to this item:
Appears in Collections:Computing Science and Mathematics Conference Papers and Proceedings
Peer Review Status: Refereed
Author(s): Christie, Lee A
Brownlee, Alexander
Woodward, John R
Contact Email:
Title: Investigating Benchmark Correlations when Comparing Algorithms with Parameter Tuning
Citation: Christie LA, Brownlee A & Woodward JR (2018) Investigating Benchmark Correlations when Comparing Algorithms with Parameter Tuning. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion. Genetic and Evolutionary Computation Conference 2018, 15.07.2018-19.07.2018. New York: ACM, pp. 209-210.
DAASE: Dynamic Adaptive Automated Software Engineering
FAIME: A Feature based Framework to Automatically Integrate and Improve Metaheuristics via Examples.
Issue Date: 31-Dec-2018
Conference Name: Genetic and Evolutionary Computation Conference 2018
Conference Dates: 2018-07-15 - 2018-07-19
Conference Location: New York
Abstract: Benchmarks are important for comparing performance of optimisation algorithms, but we can select instances that present our algorithm favourably, and dismiss those on which our algorithm under-performs. Also related are automated design of algorithms, which use problem instances (benchmarks) to train an algorithm: careful choice of instances is needed for the algorithm to generalise. We sweep parameter settings of differential evolution to applied to the BBOB benchmarks. Several benchmark functions are highly correlated. This may lead to the false conclusion that an algorithm performs well in general, when it performs poorly on a few key instances. These correlations vary with the number of evaluations.
Status: AM - Accepted Manuscript
Rights: This item has been embargoed for a period. During the embargo please use the Request a Copy feature at the foot of the Repository record to request a copy directly from the author. You can only request a copy if you wish to use this work for your own research or private study. Publisher policy allows this work to be made available in this repository. Published in Proceedings of the Genetic and Evolutionary Computation Conference Companion by ACM. The original publication is available at:

Files in This Item:
File Description SizeFormat 
investigating-benchmark-correlations-forrepository.pdfFulltext - Accepted Version84.57 kBAdobe PDFView/Open

This item is protected by original copyright

Items in the Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

If you believe that any material held in STORRE infringes copyright, please contact providing details and we will remove the Work from public display in STORRE and investigate your claim.