Search Results
Working Paper
Explaining Machine Learning by Bootstrapping Partial Marginal Effects and Shapley Values
Palmer, Nathan M.; Modig, Zach; Cook, Thomas R.
(2024-08-06)
Machine learning and artificial intelligence are often described as “black boxes.” Traditional linear regression is interpreted through its marginal relationships as captured by regression coefficients. We show that the same marginal relationship can be described rigorously for any machine learning model by calculating the slope of the partial dependence functions, which we call the partial marginal effect (PME). We prove that the PME of OLS is analytically equivalent to the OLS regression coefficient. Boot- strapping provides standard errors and confidence intervals around the point ...
Research Working Paper
, Paper RWP 21-12
Working Paper
Integrating Prediction and Attribution to Classify News
Rayl, Nelson P.; Sinha, Nitish R.
(2022-07-01)
Recent modeling developments have created tradeoffs between attribution-based models, models that rely on causal relationships, and “pure prediction models†such as neural networks. While forecasters have historically favored one technology or the other based on comfort or loyalty to a particular paradigm, in domains with many observations and predictors such as textual analysis, the tradeoffs between attribution and prediction have become too large to ignore. We document these tradeoffs in the context of relabeling 27 million Thomson Reuters news articles published between 1996 ...
Finance and Economics Discussion Series
, Paper 2022-042
Working Paper
Macroeconomic Indicator Forecasting with Deep Neural Networks
Cook, Thomas R.; Smalter Hall, Aaron
(2017-09-29)
Economic policymaking relies upon accurate forecasts of economic conditions. Current methods for unconditional forecasting are dominated by inherently linear models {{p}} that exhibit model dependence and have high data demands. {{p}} We explore deep neural networks as an {{p}} opportunity to improve upon forecast accuracy with limited data and while remaining agnostic as to {{p}} functional form. We focus on predicting civilian unemployment using models based on four different neural network architectures. Each of these models outperforms bench- mark models at short time horizons. One model, ...
Research Working Paper
, Paper RWP 17-11
Working Paper
Generative AI at the Crossroads: Light Bulb, Dynamo, or Microscope?
Baily, Martin Neil; Byrne, David M.; Kane, Aidan T.; Soto, Paul E.
(2025-07-17)
With the advent of generative AI (genAI), the potential scope of artificial intelligence has increased dramatically, but the future effect of genAI on productivity remains uncertain. The effect of the technology on the innovation process is a crucial open question. Some inventions, such as the light bulb, temporarily raise productivity growth as adoption spreads, but the effect fades when the market is saturated; that is, the level of output per hour is permanently higher but the growth rate is not. In contrast, two types of technologies stand out as having longer-lived effects on ...
Finance and Economics Discussion Series
, Paper 2025-053
Working Paper
Artificial Intelligence and Inflation Forecasts
Leibovici, Fernando; Faria-e-Castro, Miguel
(2024-01-11)
We explore the ability of Large Language Models (LLMs) to produce in-sample conditional inflation forecasts during the 2019-2023 period. We use a leading LLM (Google AI's PaLM) to produce distributions of conditional forecasts at different horizons and compare these forecasts to those of a leading source, the Survey of Professional Forecasters (SPF). We find that LLM forecasts generate lower mean-squared errors overall in most years, and at almost all horizons. LLM forecasts exhibit slower reversion to the 2% inflation anchor.
Working Papers
, Paper 2023-015
Working Paper
Artificial Intelligence and Inflation Forecasts
Leibovici, Fernando; Faria-e-Castro, Miguel
(2023-07-14)
We explore the ability of Large Language Models (LLMs) to produce conditional inflation forecasts during the 2019-2023 period. We use a leading LLM (Google AI's PaLM) to produce distributions of conditional forecasts at different horizons and compare these forecasts to those of a leading source, the Survey of Professional Forecasters (SPF). We find that LLM forecasts generate lower mean-squared errors overall in most years, and at almost all horizons. LLM forecasts exhibit slower reversion to the 2% inflation anchor. We argue that this method of generating forecasts is inexpensive and can be ...
Working Papers
, Paper 2023-015
Working Paper
Spatial Dependence and Data-Driven Networks of International Banks
Craig, Ben R.; Saldias Zambrana, Martin
(2016-12-02)
This paper computes data-driven correlation networks based on the stock returns of international banks and conducts a comprehensive analysis of their topological properties. We first apply spatial-dependence methods to filter the effects of strong common factors and a thresholding procedure to select the significant bilateral correlations. The analysis of topological characteristics of the resulting correlation networks shows many common features that have been documented in the recent literature but were obtained with private information on banks? exposures. Our analysis validates these ...
Working Papers (Old Series)
, Paper 1627
Working Paper
The Anatomy of Out-of-Sample Forecasting Accuracy
Rapach, David E.; Borup, Daniel; Goulet Coulombe, Philippe; Montes Schütte, Erik Christian; Schwenk-Nebbe, Sander
(2022-11-07)
We develop metrics based on Shapley values for interpreting time-series forecasting models, including“black-box” models from machine learning. Our metrics are model agnostic, so that they are applicable to any model (linear or nonlinear, parametric or nonparametric). Two of the metrics, iShapley-VI and oShapley-VI, measure the importance of individual predictors in fitted models for explaining the in-sample and out-of-sample predicted target values, respectively. The third metric is the performance-based Shapley value (PBSV), our main methodological contribution. PBSV measures the ...
FRB Atlanta Working Paper
, Paper 2022-16
FILTER BY year
FILTER BY Bank
Board of Governors of the Federal Reserve System (U.S.) 15 items
Federal Reserve Bank of St. Louis 8 items
Federal Reserve Bank of Kansas City 6 items
Federal Reserve Bank of Atlanta 2 items
Federal Reserve Bank of Cleveland 2 items
Federal Reserve Bank of San Francisco 1 items
show more (1)
show less
FILTER BY Series
Finance and Economics Discussion Series 15 items
Working Papers 8 items
Research Working Paper 5 items
FRB Atlanta Working Paper 2 items
Regional Research Working Paper 1 items
Review 1 items
Working Paper Series 1 items
Working Papers (Old Series) 1 items
show more (3)
show less
FILTER BY Content Type
Working Paper 33 items
Journal Article 1 items
FILTER BY Author
Brunetti, Celso 8 items
Joëts, Marc 8 items
Mignon, Valérie 8 items
Cook, Thomas R. 6 items
Faria-e-Castro, Miguel 5 items
Leibovici, Fernando 5 items
Palmer, Nathan M. 4 items
Ahrens, Maximilian 3 items
Erdemlioglu, Deniz 3 items
Lundgaard Hansen, Anne 3 items
McMahon, Michael 3 items
Neely, Christopher J. 3 items
Yang, Xiye 3 items
Borup, Daniel 2 items
Goulet Coulombe, Philippe 2 items
Modig, Zach 2 items
Montes Schütte, Erik Christian 2 items
Rapach, David E. 2 items
Schwenk-Nebbe, Sander 2 items
Sinha, Nitish R. 2 items
Smalter Hall, Aaron 2 items
Alam, M.Jahangir 1 items
Baily, Martin Neil 1 items
Boyle, Shane 1 items
Brown, Jason 1 items
Byrne, David M. 1 items
Chronopoulos, Ilias 1 items
Chrysikou, Katerina 1 items
Craig, Ben R. 1 items
Crane, Leland D. 1 items
Ge, Xiaoyu 1 items
Haberkorn, Flora 1 items
Iyengar, Rithika 1 items
Kane, Aidan T. 1 items
Kapetanios, George 1 items
Kazinnik, Sophia 1 items
Lee, Seung Jung 1 items
Li, Huiyu 1 items
Luccioli, Viviana 1 items
Maloney, Maeve 1 items
McAdam, Peter 1 items
Mitchell, James 1 items
Panley, Ryan 1 items
Puglia, Michael 1 items
Raftapostolos, Aristeidis 1 items
Rappaport, Jordan 1 items
Rayl, Nelson P. 1 items
Saldias Zambrana, Martin 1 items
Sekhposyan, Tatevik 1 items
Soto, Paul E. 1 items
Tucker, Adam 1 items
show more (46)
show less
FILTER BY Jel Classification
C53 12 items
E37 9 items
G10 9 items
C50 8 items
Q35 8 items
Q40 8 items
E31 7 items
C18 6 items
C14 5 items
C52 3 items
E52 3 items
G12 3 items
G14 3 items
C10 2 items
C15 2 items
C22 2 items
C55 2 items
C80 2 items
G21 2 items
C21 1 items
C23 1 items
C33 1 items
C38 1 items
C40 1 items
E50 1 items
G17 1 items
O31 1 items
O33 1 items
O40 1 items
R12 1 items
R32 1 items
show more (27)
show less
FILTER BY Keywords
OPEC Announcements 8 items
Structural Topic Models 8 items
Traders’ Positions 8 items
Volatility 8 items
large language models 6 items
Machine learning 5 items
inflation forecasts 5 items
artificial intelligence 4 items
Computational techniques 3 items
central bank communication 3 items
high-frequency data 3 items
multimodal machine learning 3 items
natural language processing 3 items
speech analysis 3 items
tail risk 3 items
volatility 3 items
Economic measurement 2 items
Forecasting 2 items
Gaussian process 2 items
Machine Learning 2 items
Sentiment 2 items
Shapley value 2 items
Unstructured data 2 items
inflation 2 items
loss function 2 items
machine learning 2 items
model bias 2 items
models 2 items
neural networks 2 items
Artificial Intelligence 1 items
Artificial intelligence 1 items
COVID-19 1 items
DMR 1 items
Debt 1 items
Employment density 1 items
Explainable machine learning 1 items
House prices 1 items
Labeling 1 items
LightGBM 1 items
Macroeconomic indicators 1 items
Metropolitan land use 1 items
Model interpretation 1 items
Network analysis 1 items
Neural Networks 1 items
News 1 items
Nonlinearity 1 items
Panel Data 1 items
Policy Interventions 1 items
Probit 1 items
Productivity 1 items
Random forest 1 items
Recession 1 items
Sampling 1 items
Shapley 1 items
Shapley values 1 items
Statistical inference 1 items
Supervised Learning 1 items
Support-vector machine 1 items
Survey of Professional Forecasters (SPF) 1 items
Technological Growth 1 items
Text Analysis 1 items
Treasury yield curve 1 items
Tree ensemble 1 items
XGBoost 1 items
artificial intelligence (AI) 1 items
banking 1 items
banking and finance 1 items
central business districts 1 items
data 1 items
generative AI 1 items
inflation forecasting 1 items
large language models (LLMs) 1 items
model interpretation 1 items
out-of-sample performance 1 items
predictor importance 1 items
quantitative methods 1 items
spatial dependence 1 items
variable importance 1 items
show more (73)
show less