RTSMS: Randomized Tucker with single-mode sketching

Abstract: We propose RTSMS (Randomized Tucker via Single-Mode-Sketching), a randomized algorithm for approximately computing a low-rank Tucker decomposition of a given tensor. It uses sketching and least-squares to compute the Tucker decomposition in a sequentially truncated manner. The algorithm only sketches one mode at a time, so the sketch matrices are significantly smaller than alternative approaches. The algorithm is demonstrated to be competitive with existing methods, sometimes outperforming them by a large margin.