Greedy algorithms for learning via exponential-polynomial splines (2109.14299v2)

Abstract: Kernel-based schemes are state-of-the-art techniques for learning by data. In this work we extend some ideas about kernel-based greedy algorithms to exponential-polynomial splines, whose main drawback consists in possible overfitting and consequent oscillations of the approximant. To partially overcome this issue, we introduce two algorithms which perform an adaptive selection of the spline interpolation points based on the minimization either of the sample residuals ($f$-greedy), or of an upper bound for the approximation error based on the spline Lebesgue function ($\lambda$-greedy). Both methods allow us to obtain an adaptive selection of the sampling points, i.e. the spline nodes. However, while the {$f$-greedy} selection is tailored to one specific target function, the $\lambda$-greedy algorithm is independent of the function values and enables us to define a priori optimal interpolation nodes.