GDP nowcasting with artificial neural networks: How much does long-term memory matter? (2304.05805v3)
Abstract: We apply artificial neural networks (ANNs) to nowcast quarterly GDP growth for the U.S. economy. Using the monthly FRED-MD database, we compare the nowcasting performance of five different ANN architectures: the multilayer perceptron (MLP), the one-dimensional convolutional neural network (1D CNN), the Elman recurrent neural network (RNN), the long short-term memory network (LSTM), and the gated recurrent unit (GRU). The empirical analysis presents results from two distinctively different evaluation periods. The first (2012:Q1 -- 2019:Q4) is characterized by balanced economic growth, while the second (2012:Q1 -- 2022:Q4) also includes periods of the COVID-19 recession. According to our results, longer input sequences result in more accurate nowcasts in periods of balanced economic growth. However, this effect ceases above a relatively low threshold value of around six quarters (eighteen months). During periods of economic turbulence (e.g., during the COVID-19 recession), longer input sequences do not help the models' predictive performance; instead, they seem to weaken their generalization capability. Combined results from the two evaluation periods indicate that architectural features enabling long-term memory do not result in more accurate nowcasts. Comparing network architectures, the 1D CNN has proved to be a highly suitable model for GDP nowcasting. The network has shown good nowcasting performance among the competitors during the first evaluation period and achieved the overall best accuracy during the second evaluation period. Consequently, first in the literature, we propose the application of the 1D CNN for economic nowcasting.
- “Asymptotic statistical theory of overtraining and cross-validation” In IEEE transactions on neural networks 8.5 IEEE, 1997, pp. 985–996
- “A dynamic factor model for nowcasting Canadian GDP growth” In Empirical Economics 53.1 Springer, 2017, pp. 217–234
- “Empirical evaluation of gated recurrent neural networks on sequence modeling” In arXiv preprint arXiv:1412.3555, 2014
- “Feedforward versus recurrent neural networks for forecasting monthly japanese yen exchange rates” In Financial Engineering and the Japanese Markets 3.1 Springer, 1996, pp. 59–75
- Francis X Diebold and Roberto S Mariano “Comparing Predictive Accuracy” In Journal of Business & Economic Statistics JSTOR, 1995, pp. 253–263
- Catherine Doz, Domenico Giannone and Lucrezia Reichlin “A two-step estimator for large approximate dynamic factor models based on Kalman filtering” In Journal of Econometrics 164.1 Elsevier, 2011, pp. 188–205
- Magnus Ekman “Learning Deep Learning: Theory and Practice of Neural Networks, Computer Vision, NLP, and Transformers Using TensorFlow” Addison-Wesley Professional, 2021
- Jeffrey L Elman “Finding structure in time” In Cognitive science 14.2 Wiley Online Library, 1990, pp. 179–211
- Prakhar Ganesh “Types of Convolution Kernels: Simplified” Towards Data Science, 2019 URL: https://towardsdatascience.com/types-of-convolution-kernels-simplified-f040cb307c37
- Domenico Giannone, Lucrezia Reichlin and David Small “Nowcasting: The real-time informational content of macroeconomic data” In Journal of monetary economics 55.4 Elsevier, 2008, pp. 665–676
- Ian Goodfellow, Yoshua Bengio and Aaron Courville “Deep Learning” http://www.deeplearningbook.org MIT Press, 2016
- William H Greene “Econometric analysis” Pearson Education, 2017
- Saeed Heravi, Denise R Osborn and CR Birchenhall “Linear versus neural network forecasts for European industrial production series” In International Journal of Forecasting 20.3 Elsevier, 2004, pp. 435–446
- “Long short-term memory” In Neural computation 9.8 MIT Press, 1997, pp. 1735–1780
- Robert J. Hodrick and Edward C. Prescott “Postwar U.S. Business Cycles: An Empirical Investigation” In Journal of Money, Credit and Banking 29, 1997, pp. 1–16 URL: https://api.semanticscholar.org/CorpusID:154995815
- Daniel Hopp “Economic nowcasting with long short-term memory artificial neural networks (LSTM)” In arXiv preprint arXiv:2106.08901, 2021
- Yuan Jiang, Yunxiao He and Heping Zhang “Variable selection with prior information for generalized linear models via the prior LASSO method” In Journal of the American Statistical Association 111.513 Taylor & Francis, 2016, pp. 355–376
- “1D convolutional neural networks and applications: A survey” In Mechanical systems and signal processing 151 Elsevier, 2021, pp. 107398
- Nikolaos Kourentzes, Devon K Barrow and Sven F Crone “Neural network ensemble operators for time series forecasting” In Expert Systems with Applications 41.9 Elsevier, 2014, pp. 4235–4244
- “Forecasting exchange rates using feedforward and recurrent neural networks” In Journal of applied econometrics 10.4 Wiley Online Library, 1995, pp. 347–364
- “Nowcasting US GDP with artificial neural networks”, 2019
- “Factor MIDAS for nowcasting and forecasting with ragged-edge data: A model comparison for German GDP” In Oxford Bulletin of Economics and Statistics 72.4 Wiley Online Library, 2010, pp. 518–550
- Troy D Matheson “New indicators for tracking growth in real time” In OECD Journal: Journal of Business Cycle Measurement and Analysis 2013.2 OECD, 2014, pp. 51–71
- Michael W McCracken and Serena Ng “FRED-MD: A monthly database for macroeconomic research” In Journal of Business & Economic Statistics 34.4 Taylor & Francis, 2016, pp. 574–589
- Christopher Olah “Understanding LSTM Networks”, 2015 URL: http://colah.github.io/posts/2015-08-Understanding-LSTMs/
- James H Stock and Mark W Watson “Forecasting using principal components from a large number of predictors” In Journal of the American statistical association 97.460 Taylor & Francis, 2002, pp. 1167–1179
- Greg Tkacz “Neural network forecasting of Canadian GDP growth” In International Journal of Forecasting 17.1 Elsevier, 2001, pp. 57–69
- Douglas Garcia Torres and Hongliang Qiu “Applying recurrent neural networks for multivariate time series forecasting of volatile financial data” In KTH Royal Institute of Technology: Stockholm, Sweden, 2018
- Kenneth F Wallis “Forecasting with an econometric model: The ‘ragged edge’problem” In Journal of Forecasting 5.1 Wiley Online Library, 1986, pp. 1–13
- Paul J Werbos “Backpropagation through time: what it does and how to do it” In Proceedings of the IEEE 78.10 IEEE, 1990, pp. 1550–1560
- Kristóf Németh (2 papers)
- Dániel Hadházi (2 papers)