First Steps Towards a Runtime Analysis When Starting With a Good Solution (2006.12161v3)
Abstract: The mathematical runtime analysis of evolutionary algorithms traditionally regards the time an algorithm needs to find a solution of a certain quality when initialized with a random population. In practical applications it may be possible to guess solutions that are better than random ones. We start a mathematical runtime analysis for such situations. We observe that different algorithms profit to a very different degree from a better initialization. We also show that the optimal parameterization of the algorithm can depend strongly on the quality of the initial solutions. To overcome this difficulty, self-adjusting and randomized heavy-tailed parameter choices can be profitable. Finally, we observe a larger gap between the performance of the best evolutionary algorithm we found and the corresponding black-box complexity. This could suggest that evolutionary algorithms better exploiting good initial solutions are still to be found. These first findings stem from analyzing the performance of the $(1+1)$ evolutionary algorithm and the static, self-adjusting, and heavy-tailed $(1 + (\lambda,\lambda))$ GA on the OneMax benchmark. We are optimistic that the question how to profit from good initial solutions is interesting beyond these first examples.
- Fast mutation in crossover-based algorithms. Algorithmica, 84:1724–1761, 2022.
- Lazy parameter tuning and control: Choosing all parameters randomly from a power-law distribution. Algorithmica, 2023. To appear.
- Anne Auger and Benjamin Doerr, editors. Theory of Randomized Search Heuristics. World Scientific Publishing, 2011.
- A tight runtime analysis for the (μ+λ)𝜇𝜆{(\mu+\lambda)}( italic_μ + italic_λ ) EA. Algorithmica, 83:1054–1095, 2021.
- A tight runtime analysis for the (1+(λ,λ))1𝜆𝜆{(1+(\lambda,\lambda))}( 1 + ( italic_λ , italic_λ ) ) GA on LeadingOnes. In Foundations of Genetic Algorithms, FOGA 2019, pages 169–182. ACM, 2019.
- A rigorous runtime analysis of the (1+(λ,λ))1𝜆𝜆{(1+(\lambda,\lambda))}( 1 + ( italic_λ , italic_λ ) ) GA on jump functions. Algorithmica, 84:1573–1602, 2022.
- Computing single source shortest paths using single-objective fitness. In Foundations of Genetic Algorithms, FOGA 2009, pages 59–66. ACM, 2009.
- Runtime analysis of the (1+(λ,λ))1𝜆𝜆{(1+(\lambda,\lambda))}( 1 + ( italic_λ , italic_λ ) ) genetic algorithm on random satisfiable 3-CNF formulas. In Genetic and Evolutionary Computation Conference, GECCO 2017, pages 1343–1350. ACM, 2017.
- Fixed-target runtime analysis. Algorithmica, 84:1762–1793, 2022.
- Optimal static and self-adjusting parameter choices for the (1+(λ,λ))1𝜆𝜆{(1+(\lambda,\lambda))}( 1 + ( italic_λ , italic_λ ) ) genetic algorithm. Algorithmica, 80:1658–1709, 2018.
- From black-box complexity to designing new genetic algorithms. Theoretical Computer Science, 567:87–104, 2015.
- Fast re-optimization via structural diversity. In Genetic and Evolutionary Computation Conference, GECCO 2019, pages 233–241. ACM, 2019.
- Optimal parameter choices via precise black-box analysis. Theoretical Computer Science, 801:1–34, 2020.
- Sharp bounds by probability-generating functions and variable drift. In Genetic and Evolutionary Computation Conference, GECCO 2011, pages 2083–2090. ACM, 2011.
- Adaptive drift analysis. Algorithmica, 65:224–250, 2013.
- Adjacency list matchings: an ideal genotype for cycle covers. In Genetic and Evolutionary Computation Conference, GECCO 2007, pages 1203–1210. ACM, 2007.
- Edge-based representation beats vertex-based representation in shortest path problems. In Genetic and Evolutionary Computation Conference, GECCO 2010, pages 759–766. ACM, 2010.
- Faster black-box algorithms through higher arity operators. In Foundations of Genetic Algorithms, FOGA 2011, pages 163–172. ACM, 2011.
- On the analysis of the (1+1) evolutionary algorithm. Theoretical Computer Science, 276:51–81, 2002.
- Upper and lower bounds for randomized search heuristics in black-box optimization. Theory of Computing Systems, 39:525–544, 2006.
- Multiplicative drift analysis. Algorithmica, 64:673–697, 2012.
- Optimizing linear functions with the (1+λ)1𝜆(1+\lambda)( 1 + italic_λ ) evolutionary algorithm—different asymptotic runtimes for different instances. Theoretical Computer Science, 561:3–23, 2015.
- Fast genetic algorithms. In Genetic and Evolutionary Computation Conference, GECCO 2017, pages 777–784. ACM, 2017.
- Benjamin Doerr and Frank Neumann, editors. Theory of Evolutionary Computation—Recent Developments in Discrete Optimization. Springer, 2020. Also available at http://www.lix.polytechnique.fr/Labo/Benjamin.Doerr/doerr_neumann_book.html.
- Simulated annealing is a polynomial-time approximation scheme for the minimum spanning tree problem. CoRR, abs/2204.02097, 2022.
- On two problems of information theory. Magyar Tudományos Akadémia Matematikai Kutató Intézet Közleményei, 8:229–243, 1963.
- Theoretical and empirical analysis of parameter control mechanisms in the (1+(λ,λ))1𝜆𝜆(1+(\lambda,\lambda))( 1 + ( italic_λ , italic_λ ) ) genetic algorithm. ACM Transactions on Evolutionary Learning and Optimization, 2:13:1–13:39, 2022.
- Drift analysis and average time complexity of evolutionary algorithms. Artificial Intelligence, 127:51–81, 2001.
- Thomas Jansen. Analyzing Evolutionary Algorithms – The Computer Science Perspective. Springer, 2013.
- On the choice of the offspring population size in evolutionary algorithms. Evolutionary Computation, 13:413–440, 2005.
- Daniel Johannsen. Random Combinatorial Structures and Randomized Search Heuristics. PhD thesis, Universität des Saarlandes, 2010.
- Performance analysis of randomised search heuristics operating with a fixed budget. Theoretical Computer Science, 545:39–58, 2014.
- W. Koepf. Hypergeometric Summation: An Algorithmic Approach to Summation and Special Function Identities. Vieweg, Braunschweig, Germany, 1998.
- Ching-Fang Liaw. A hybrid genetic algorithm for the open shop scheduling problem. European Journal of Operations Research, 124:28–42, 2000.
- Black-box search by unbiased variation. Algorithmica, 64:623–642, 2012.
- Theoretical analysis of local search strategies to optimize network communication subject to preserving the total number of links. International Journal on Intelligent Computing and Cybernetics, 2:243–284, 2009.
- Heinz Mühlenbein. How genetic algorithms really work: mutation and hillclimbing. In Parallel Problem Solving from Nature, PPSN 1992, pages 15–26. Elsevier, 1992.
- Analysis of evolutionary algorithms in dynamic and stochastic environments. In Benjamin Doerr and Frank Neumann, editors, Theory of Evolutionary Computation: Recent Developments in Discrete Optimization, pages 323–357. Springer, 2020. Also available at https://arxiv.org/abs/1806.08547.
- Randomized local search, evolutionary algorithms, and the minimum spanning tree problem. Theoretical Computer Science, 378:32–40, 2007.
- Bioinspired Computation in Combinatorial Optimization – Algorithms and Their Computational Complexity. Springer, 2010.
- The choice of the offspring population size in the (1,λ)1𝜆{(1,\lambda)}( 1 , italic_λ ) evolutionary algorithm. Theoretical Computer Science, 545:20–38, 2014.
- Unbiased black box search algorithms. In Proc. of GECCO’11, pages 2035–2042. ACM, 2011.
- A theory and algorithms for combinatorial reoptimization. Algorithmica, 80:576–607, 2018.
- Abraham Wald. Some generalizations of the theory of cumulative sums of random variables. The Annals of Mathematical Statistics, 16:287–293, 1945.
- Ingo Wegener. Theoretical aspects of evolutionary algorithms. In Automata, Languages and Programming, ICALP 2001, pages 64–78. Springer, 2001.
- Carsten Witt. Runtime analysis of the (μ𝜇\muitalic_μ + 1) EA on simple pseudo-Boolean functions. Evolutionary Computation, 14:65–86, 2006.
- Anna Zych-Pawlewicz. Reoptimization of NP-hard problems. In Adventures Between Lower Bounds and Higher Altitudes – Essays Dedicated to Juraj Hromkovič on the Occasion of His 60th Birthday, pages 477–494. Springer, 2018.
- Evolutionary Learning: Advances in Theories and Algorithms. Springer, 2019.
- Denis Antipov (17 papers)
- Maxim Buzdalov (18 papers)
- Benjamin Doerr (131 papers)