2000 character limit reached
A Linear Time Natural Evolution Strategy for Non-Separable Functions (1106.1998v2)
Published 10 Jun 2011 in cs.AI
Abstract: We present a novel Natural Evolution Strategy (NES) variant, the Rank-One NES (R1-NES), which uses a low rank approximation of the search distribution covariance matrix. The algorithm allows computation of the natural gradient with cost linear in the dimensionality of the parameter space, and excels in solving high-dimensional non-separable problems, including the best result to date on the Rosenbrock function (512 dimensions).