Search Results
Showing results 1 to 2 of approximately 2.
(refine search)
Working Paper
Evaluating Local Language Models: An Application to Bank Earnings Calls
This study evaluates the performance of local large language models (LLMs) in interpreting financial texts, compared with closed-source, cloud-based models. We first introduce new benchmarking tasks for assessing LLM performance in analyzing financial and economic texts and explore the refinements needed to improve its performance. Our benchmarking results suggest local LLMs are a viable tool for general natural language processing analysis of these texts. We then leverage local LLMs to analyze the tone and substance of bank earnings calls in the post-pandemic era, including calls conducted ...
Working Paper
Surveys of Professionals
This chapter provides an overview of surveys of professional forecasters, with a focus on the U.S. Survey of Professional Forecasters and the European Central Bank Survey of Professional Forecasters. A distinguishing feature of these surveys is that they collect point and density forecasts and make the data publicly available. We discuss their structure, issues involved in using the data, and the construction of measures such as disagreement and uncertainty at the aggregate and individual levels. Our review also summarizes the findings of studies exploring issues such as the alignment of ...