Skip to main content
SpringerLink
Log in

A study on scale factor/crossover interaction in distributed differential evolution

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

This paper studies the use of multiple scale factor values within distributed Differential Evolution structures employing the so-called exponential crossover. Four different scale factor schemes are proposed, tested, compared and analyzed. Two schemes simply employ multiple scale factor values and two also include an update logic during the evolution. The four schemes have been integrated for comparison within three recently proposed distributed Differential Evolution structures and tested on several various test problems. The results are then compared to those of a previous study where the so-called binomial crossover was employed. Numerical results show that, when associated to the exponential crossover, the employment of multiple scale factors is not systematically beneficial and in some cases even detrimental to the performance of the algorithm. The exponential crossover accentuates the exploitative character of the Differential Evolution, which cannot always be counterbalanced by the increase in the explorative aspect of the algorithm introduced by the employment of multiple scale factor values.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Alba E, Tomassini M (2002) Parallelism and evolutionary algorithms. IEEE Trans Evol Comput 6(5): 443–462

    Article  Google Scholar 

  • Apolloni J, Leguizamón G, García-Nieto J, Alba E (2008) Island based distributed differential evolution: an experimental study on hybrid testbeds. In: Proceedings of the IEEE international conference on hybrid intelligent systems, pp 696–701

  • Brest J, Maučec MS (2008) Population size reduction for the differential evolution algorithm. Appl Intell 29(3): 228–247

    Article  Google Scholar 

  • Brest J, Greiner S, Bošković B, Mernik M, Žumer V (2006) Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems. IEEE Trans Evol Comput 10(6): 646–657

    Article  Google Scholar 

  • Brest J, Zamuda A, Bošković B, Maucec MS, Žumer V (2008) High-dimensional real-parameter optimization using self-adaptive differential evolution algorithm with population size reduction. In: Proceedings of the IEEE world congress on computational intelligence, pp 2032–2039

  • Caponio A, Neri F (2009) Differential evolution with noise analysis. In: Applications of evolutionary Computing, lecture notes in computer science, vol 5484. Springer, pp 715–724

  • Chakraborty, UK (ed) (2008) Advances in differential evolution, studies in computational intelligence, vol 143. Springer, Berlin

    Google Scholar 

  • Das S, Konar A, Chakraborty UK (2005) Two improved differential evolution schemes for faster global search. In: Proceedings of the 2005 conference on genetic and evolutionary computation. ACM, New York, pp 991–998

  • De Falco I, Della Cioppa A, Maisto D, Scafuri U, Tarantino E (2007a) Satellite image registration by distributed differential evolution. In: Applications of evolutionary computing, lectures notes in computer science, vol 4448, Springer, pp 251–260

  • De Falco I, Maisto D, Scafuri U, Tarantino E, Della Cioppa A (2007b) Distributed differential evolution for the registration of remotely sensed images. In: Proceedings of the IEEE euromicro international conference on parallel, distributed and network-based processing, pp 358–362

  • De Falco I, Scafuri U, Tarantino E, Della Cioppa A (2007c) A distributed differential evolution approach for mapping in a grid environment. In: Proceedings of the IEEE euromicro international conference on parallel, distributed and network-based processing, pp 442–449

  • Fan HY, Lampinen J (2003) A trigonometric mutation operation to differential evolution. J Glob Optim 27(1): 105–129

    Article  MathSciNet  MATH  Google Scholar 

  • Feoktistov V (2006) Differential evolution in search of solutions. Springer, Berlin

    MATH  Google Scholar 

  • Gämperle R, Müller SD, Koumoutsakos P (2002) A parameter study for differential evolution. In: Proceedings of the conference in neural networks and applications (NNA), fuzzy sets and fuzzy systems (FSFS) and evolutionary computation (EC), WSEAS, pp 293–298

  • Herrera F, Lozano M, Molina D (2010) Components and parameters of de, real-coded chc, and g-cmaes. Web document. http://sci2s.ugr.es/eamhco/descriptions.pdf

  • Karaboga D, Akay B (2009) A survey: algorithms simulating bee swarm intelligence. Artif Intell Rev 31(1–4): 61–85

    Article  Google Scholar 

  • Kozlov KN, Samsonov AM (2006) New migration scheme for parallel differential evolution. In: Proceedings of the international conference on bioinformatics of genome regulation and structure, pp 141–144

  • Kwedlo W, Bandurski K (2006) A parallel differential evolution algorithm. In: Proceedings of the IEEE international symposium on parallel computing in electrical engineering, pp 319–324

  • Lampinen J (1999) Differential evolution—new naturally parallel approach for engineering design optimization. In: Topping BH (ed) Developments in computational mechanics with high performance computing. Civil-Comp Press, UK, pp 217–228

    Chapter  Google Scholar 

  • Lampinen J, Zelinka I (2000) On stagnation of the differential evolution algorithm. In: Oŝmera P (ed) Proceedings of 6th international mendel conference on soft computing, pp 76–83

  • Liu J, Lampinen J (2002a) A fuzzy adaptive differential evolution algorithm. In: Proceedings of the 17th IEEE region 10 international conference on computer, communications, control and power engineering, vol 1, pp 606–611

  • Liu J, Lampinen J (2002b) On setting the control parameter of the differential evolution algorithm. In: Proceedings of the 8th international mendel conference on soft computing, pp 11–18

  • Mallipeddi R, Suganthan PN (2008) Empirical study on the effect of population size on differential evolution algorithm. In: Proceedings of the IEEE congress on evolutionary computation, pp 3663–3670

  • Neri F, Tirronen V (2008) On memetic differential evolution frameworks: a study of advantages and limitations in hybridization. In: Proceedings of the IEEE world congress on computational intelligence, pp 2135–2142

  • Neri F, Tirronen V (2009) Scale factor local search in differential evolution. Memet Comput 1(2): 153–171

    Article  Google Scholar 

  • Neri F, Tirronen V (2010) Recent advances in differential evolution: a review and experimental analysis. Artif Intell Rev 33(1): 61–106

    Article  Google Scholar 

  • Neri F, Tirronen V, Kärkkäinen T (2009) Enhancing differential evolution frameworks by scale factor local search—part II. In: Proceedings of the IEEE congress on evolutionary computation, pp 118–125

  • Nipteni MS, Valakos I, Nikolos I (2006) An asynchronous parallel differential evolution algorithm. In: Proceedings of the ERCOFTAC conference on design optimisation: methods and application

  • Noman N, Iba H (2005) Enhancing differential evolution performance with local search for high dimensional function optimization. In: Proceedings of the 2005 conference on genetic and evolutionary computation. ACM, New York, pp 967–974

  • Olorunda O, Engelbrecht A (2007) Differential evolution in high-dimensional search spaces. In: Proceedings of the IEEE congress on evolutionary computation, pp 1934–1941

  • Omran MG, Salman A, Engelbrecht AP (2005) Self-adaptive differential evolution. In: Computational intelligence and security, lecture notes in computer science, vol 3801. Springer, Berlin, pp 192–199

  • Pavlidis NG, Tasoulis DK, Plagianakos VP, Nikiforidis G, Vrahatis MN (2005) Spiking neural network training using evolutionary algorithms. In: Proceedings of the IEEE international joint conference on neural networks, pp 2190–2194

  • Price K, Storn R (1997) Differential evolution: a simple evolution strategy for fast optimization. Dr Dobb’s J Softw Tools 22(4): 18–24

    MathSciNet  Google Scholar 

  • Price KV (1999) Mechanical engineering design optimization by differential evolution. In: Corne D, Dorigo M, Glover F (eds) New ideas in optimization. McGraw-Hill, New Delhi, pp 293–298

    Google Scholar 

  • Price KV, Storn R, Lampinen J (2005) Differential evolution: a practical approach to global optimization. Springer, Berlin

    MATH  Google Scholar 

  • Qin AK, Suganthan PN (2005) Self-adaptive differential evolution algorithm for numerical optimization. In: Proceedings of the IEEE congress on evolutionary computation, vol 2, pp 1785–1791

  • Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13: 398–417

    Article  Google Scholar 

  • Rönkkönen J, Lampinen J (2003) On using normally distributed mutation step length for the differential evolution algorithm. In: Matousek R, Osmera P (eds) Proceedings of ninth international MENDEL conference on soft computing, pp 11–18

  • Rönkkönen J, Kukkonen S, Price KV (2005) Real-parameter optimization with differential evolution. In: Proceedings of IEEE international conference on evolutionary computation, vol 1, pp 506–513

  • Salman A, Engelbrecht AP, Omran MG (2007) Empirical analysis of self-adaptive differential evolution. Eur J Oper Res 183(2): 785–804

    Article  MATH  Google Scholar 

  • Salomon M, Perrin GR, Heitz F, Armspach JP (2005) Parallel differential evolution: Application to 3-d medical image registration. In: Price KV, Storn RM, Lampinen JA (eds) Differential evolution–a practical approach to global optimization chap 7, natural computing series. Springer, Berlin, pp 353–411

    Google Scholar 

  • Soliman OS, Bui LT (2008) A self-adaptive strategy for controlling parameters in differential evolution. In: Proceedings of the IEEE congress on evolutionary computation, pp 2837–2842

  • Soliman OS, Bui LT, Abbass HA (2007) The effect of a stochastic step length on the performance of the differential evolution algorithm. In: Proceedings of the IEEE congress on evolutionary computation, pp 2850–2857

  • Storn R (1999) System design by constraint adaptation and differential evolution.IEEE Trans Evol Comput 3(1): 22–34

    Article  Google Scholar 

  • Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces. Technical Report TR-95-012, ICSI

  • Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11: 341–359

    Article  MathSciNet  MATH  Google Scholar 

  • Tasoulis DK, Pavlidis NG, Plagianakos VP, Vrahatis MN (2004) Parallel differential evolution. In: Proceedings of the IEEE congress on evolutionary computation, pp 2023–2029

  • Tirronen V, Neri F, Rossi T (2009) Enhancing differential evolution frameworks by scale factor local search—part I. In: Proceedings of the IEEE congress on evolutionary computation, pp 94–101

  • Weber M, Neri F, Tirronen V (2009) Distributed differential evolution with explorative-exploitative population families. Genet Program Evolv Mach 10(4): 343–371

    Article  Google Scholar 

  • Weber M, Neri F, Tirronen V (2010) Shuffle or update parallel differential evolution for large-scale optimization. Soft Comput (To appear)

  • Weber M, Neri F, Tirronen V (2011) A study on scale factor in distributed differential evolution. Inf Sci 181: 2488–2511

    Article  Google Scholar 

  • Wilcoxon F (1945) Individual comparisons by ranking methods. Biom Bull 1(6): 80–83

    Article  Google Scholar 

  • Zaharie D (2002a) Critical values for control parameters of differential evolution algorithm. In: Matuŝek R, Oŝmera P (eds) Proceedings of 8th international mendel conference on soft computing, pp 62–67

  • Zaharie D (2002b) Parameter adaptation in differential evolution by controlling the population diversity. In: D Petcu et al. (eds) Proceedings of the international workshop on symbolic and numeric algorithms for scientific computing, pp 385–397

  • Zaharie D (2003) Control of population diversity and adaptation in differential evolution algorithms. In: Matoušek R, Ošmera P (eds) Proceedings of MENDEL international conference on soft computing, pp 41–46

  • Zaharie D, Petcu D (2003) Parallel implementation of multi-population differential evolution. In: Proceedings of the NATO advanced research workshop on concurrent information processing and computing. IOS Press, Amsterdam, pp 223–232

  • Zhang J, Sanderson AC (2009) Jade: Adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5): 945–958

    Article  Google Scholar 

  • Zielinski K, Weitkemper P, Laur R, Kammeyer KD (2006) Parameter study for differential evolution using a power allocation problem including interference cancellation. In: Proceedings of the IEEE congress on evolutionary computation, pp 1857–1864

Download references

Author information

Authors and Affiliations

  1. Department of Mathematical Information Technology, University of Jyväskylä, Agora, P.O. Box 35, Jyväskylä, 40014, Finland

    Matthieu Weber, Ferrante Neri & Ville Tirronen

Authors
  1. Matthieu Weber
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ferrante Neri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ville Tirronen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ferrante Neri.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Weber, M., Neri, F. & Tirronen, V. A study on scale factor/crossover interaction in distributed differential evolution. Artif Intell Rev 39, 195–224 (2013). https://doi.org/10.1007/s10462-011-9267-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-011-9267-1

Keywords

Search

Navigation