Please use this identifier to cite or link to this item: http://hdl.handle.net/1893/34421
Full metadata record
DC FieldValueLanguage
dc.contributor.authorBrownlee, Alexander E Ien_UK
dc.contributor.authorEpitropakis, Michael Gen_UK
dc.contributor.authorMulder, Jeroenen_UK
dc.contributor.authorPaelinck, Marcen_UK
dc.contributor.authorBurke, Edmund Ken_UK
dc.date.accessioned2022-06-22T00:00:19Z-
dc.date.available2022-06-22T00:00:19Z-
dc.date.issued2022-07-05en_UK
dc.identifier.urihttp://hdl.handle.net/1893/34421-
dc.description.abstractIndustrial software often has many parameters that critically impact performance. Frequently, these are left in a sub-optimal configuration for a given application because searching over possible configurations is costly and, except for developer instinct, the relationships between parameters and performance are often unclear and complex. While there have been significant advances in automated parameter tuning approaches recently, they are typically black-box. The high-quality solutions produced are returned to the user without explanation. The nature of optimisation means that, often, these solutions are far outside the well-established settings for the software, making it difficult to accept and use them. To address the above issue, a systematic approach to software parameter optimization is presented. Several well-established techniques are followed in sequence, each underpinning the next, with rigorous analysis of the search space. This allows the results to be explainable to both end users and developers , improving confidence in the optimal solutions, particularly where they are counter-intuitive. The process comprises statistical analysis of the parameters; single-objective optimization for each target objective; functional ANOVA to explain trends and inter-parameter interactions; and a multi-objective optimization seeded with the results from the single-objective stage. A case study demonstrates application to business-critical software developed by the international airline Air France-KLM for measuring flight schedule robustness. A. 2 Alexander E. I. Brownlee et al. configuration is found with a run-time of 80% that of the tried-and-tested configuration, with no loss in predictive accuracy. The configuration is supplemented with detailed analysis explaining the importance of each parameter, how they interact with each other, how they influence run-time and accuracy , and how the final configuration was reached. In particular, this explains why the configuration included some parameter settings that were outwith the usually recommended range, greatly increasing developer confidence and encouraging adoption of the new configuration.en_UK
dc.language.isoenen_UK
dc.publisherBMCen_UK
dc.relationBrownlee AEI, Epitropakis MG, Mulder J, Paelinck M & Burke EK (2022) A systematic approach to parameter optimization and its application to flight schedule simulation software. Journal of Heuristics. https://doi.org/10.1007/s10732-022-09501-8en_UK
dc.rightsThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.en_UK
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en_UK
dc.subjectParameter tuningen_UK
dc.subjectoptimizationen_UK
dc.subjectstatistical methodsen_UK
dc.subjectmulti-objective optimizationen_UK
dc.subjectsearch-based software engineeringen_UK
dc.subjectexplanationen_UK
dc.titleA systematic approach to parameter optimization and its application to flight schedule simulation softwareen_UK
dc.typeJournal Articleen_UK
dc.rights.embargodate2022-07-05en_UK
dc.identifier.doi10.1007/s10732-022-09501-8en_UK
dc.citation.jtitleJournal of Heuristicsen_UK
dc.citation.issn1572-9397en_UK
dc.citation.issn1381-1231en_UK
dc.citation.peerreviewedRefereeden_UK
dc.type.statusVoR - Version of Recorden_UK
dc.contributor.funderEngineering and Physical Sciences Research Councilen_UK
dc.author.emailalexander.brownlee@stir.ac.uken_UK
dc.citation.date05/07/2022en_UK
dc.description.notesOutput Status: Forthcoming/Available Onlineen_UK
dc.contributor.affiliationComputing Scienceen_UK
dc.contributor.affiliationThe Signal Groupen_UK
dc.contributor.affiliationKLM Royal Dutch Airlines, The Netherlandsen_UK
dc.contributor.affiliationKLM Royal Dutch Airlines, The Netherlandsen_UK
dc.contributor.affiliationUniversity of Leicesteren_UK
dc.identifier.scopusid2-s2.0-85133428509en_UK
dc.identifier.wtid1823073en_UK
dc.contributor.orcid0000-0003-2892-5059en_UK
dc.date.accepted2022-06-17en_UK
dcterms.dateAccepted2022-06-17en_UK
dc.date.filedepositdate2022-06-17en_UK
dc.relation.funderprojectDAASE: Dynamic Adaptive Automated Software Engineeringen_UK
dc.relation.funderrefEP/J017515/1en_UK
rioxxterms.apcpaiden_UK
rioxxterms.typeJournal Article/Reviewen_UK
rioxxterms.versionVoRen_UK
local.rioxx.authorBrownlee, Alexander E I|0000-0003-2892-5059en_UK
local.rioxx.authorEpitropakis, Michael G|en_UK
local.rioxx.authorMulder, Jeroen|en_UK
local.rioxx.authorPaelinck, Marc|en_UK
local.rioxx.authorBurke, Edmund K|en_UK
local.rioxx.projectEP/J017515/1|Engineering and Physical Sciences Research Council|http://dx.doi.org/10.13039/501100000266en_UK
local.rioxx.freetoreaddate2022-07-05en_UK
local.rioxx.licencehttp://www.rioxx.net/licenses/under-embargo-all-rights-reserved||2022-07-05en_UK
local.rioxx.licencehttp://creativecommons.org/licenses/by/4.0/|2022-07-05|en_UK
local.rioxx.filenameBrownlee2022_Article_ASystematicApproachToParameter.pdfen_UK
local.rioxx.filecount1en_UK
local.rioxx.source1572-9397en_UK
Appears in Collections:Computing Science and Mathematics Journal Articles

Files in This Item:
File Description SizeFormat 
Brownlee2022_Article_ASystematicApproachToParameter.pdfFulltext - Published Version1.24 MBAdobe PDFView/Open


This item is protected by original copyright



A file in this item is licensed under a Creative Commons License Creative Commons

Items in the Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

The metadata of the records in the Repository are available under the CC0 public domain dedication: No Rights Reserved https://creativecommons.org/publicdomain/zero/1.0/

If you believe that any material held in STORRE infringes copyright, please contact library@stir.ac.uk providing details and we will remove the Work from public display in STORRE and investigate your claim.