Research
LLM economicus? Mapping the Behavioral Biases of LLMs via Utility Theory (Working Paper)
Ross, Jillian, Yoon Kim, and Andrew W. Lo (2024), LLM economicus? Mapping the Behavioral Biases of LLMs via Utility Theory, Working Paper, arXiv:2408.02784.
View abstract
Hide abstract
Humans are not homo economicus (i.e., rational economic beings). As humans, we exhibit systematic behavioral biases such as loss aversion, anchoring, framing, etc., which lead us to make suboptimal economic decisions. Insofar as such biases may be embedded in text data on which large language models (LLMs) are trained, to what extent are LLMs prone to the same behavioral biases? Understanding these biases in LLMs is crucial for deploying LLMs to support human decision-making. We propose utility theory-a paradigm at the core of modern economic theory-as an approach to evaluate the economic biases of LLMs. Utility theory enables the quantification and comparison of economic behavior against benchmarks such as perfect rationality or human behavior. To demonstrate our approach, we quantify and compare the economic behavior of a variety of open- and closed-source LLMs. We find that the economic behavior of current LLMs is neither entirely human-like nor entirely economicus-like. We also find that most current LLMs struggle to maintain consistent economic behavior across settings. Finally, we illustrate how our approach can measure the effect of interventions such as prompting on economic biases.
Global Realignment in Financial Market Dynamics (Working Paper)
Billio, Monica, Andrew W. Lo, Loriana Pelizzon, Mila Getmansky Sherman, and Abalfazl Zareei (2023), Global Realignment in Financial Market Dynamices, SAFE Working Paper No. 304.
View abstract
Hide abstract
We examine the leading role of the United States in the global equity markets by building daily snapshots of lead-lag price discovery networks using high-frequency country ETF returns. We find that the centrality of the U.S. equity market has been waning over time. Consistent with an explanation of gradual information diffusion, we empirically show that the shift to a multipolar system in the global equity markets can be explained by changes in information supply and demand. Using the COVID-19 pandemic as an exogenous shock, we document a causal relationship between news and country-specific price discovery network centralities.
Paying Off the Competition: Contracting, Market Power, and Innovation Incentives (Working Paper)
Li, Xuelin, Andrew W. Lo, and Richard T. Thakor (2024), Paying Off the Competition: Contracting, Market Power, and Innovation Incentives, Working Paper.
View abstract
Hide abstract
This paper explores the relationship between a firm's legal contracting environment and its innovation incentives. Using granular data from the pharmaceutical industry, we examine a contracting mechanism through which incumbents maintain market power: "pay-for-delay'' agreements to delay the market entry of competitors. Exploiting a shock where such contracts become legally tenuous, we find that affected incumbents subsequently increase their innovation activity across a variety of project-level measures. Exploring the nature of this innovation, we also find that it is more "impactful’’ from a scientific and commercial standpoint. The results provide novel evidence that restricting the contracting space can boost innovation at the firm level. However, at the extensive margin we find a reduction in innovation by new entrants in response to increased competition, suggesting a nuanced effect on aggregate innovation.
Debiasing Probability of Success Estimates for Clinical Trials
Chaudhuri, Shomesh, Joonhyuk Cho, Andrew W. Lo, Manish Singh, and Chi Heem Wong, Unpublished paper.
View abstract
Hide abstract
Due to the “boundary effect” bias, PoS estimates in the most recent years are inflated. To address this issue, we compute a bias-adjustment factor using historical data and multiply the PoS in recent years by this factor.
The Risk, Reward, and Asset Allocation of Nonprofit Endowment Funds (Working Paper)
Lo, Andrew W., Egor Matveyev, and Stefan Zeume (2021), The Risk, Reward, and Asset Allocation of Nonprofit Endowment Funds, Working Paper.
View abstract
Hide abstract
We collect tax return data from all 311,222 public NPOs in the United States over the 2009-2017 period to study the asset allocation choices and investment returns of their endowment funds. One in nine public NPOs have endowment funds. The majority of funds allocate their assets conservatively to low-risk assets, and as a result, earn an average annual return of 5.3%. There is substantial heterogeneity in investment returns across funds. Large funds significantly outperform small funds across all return measures and nonprofit sectors. Endowments in NPO sectors devoted to public and societal benefit, the environment, and the arts are among the top performers. High returns among higher education endowments are explained by size, while hospital endowments significantly underperform. Higher investment returns are associated with better governance, more highly paid management, lower discretionary spending, and lower investment management fees. Lastly, when faced with volatile contributions, endowment funds hold more cash and invest more conservatively.
Optimal Financing for R&D-Intensive Firms (Working Paper)
Thakor, Richard T. and Andrew W. Lo (2023), Optimal Financing for R&D-Intensive Firms, Working Paper.
View abstract
Hide abstract
We develop a theory of optimal financing for R&D-intensive firms. With only market financing, the firm relies exclusively on equity financing and carries excess cash, but underinvests in R&D. We use mechanism design to examine how intermediated financing can attentuate this underinvestment. The mechanism combines equity with put options such that investors insure firms against R&D failure and firms insure investors against high R&D payoffs not being realized.
Dou, Winston Wei, Xiang Fang, Andrew W. Lo, and Harald Uhlig (2023), Macro-Finance Models with Nonlinear Dynamics, Annual Review of Financial Economics 15, 407–432.
View abstract
Hide abstract
We provide a review of macro-finance models featuring nonlinear dynamics. We survey the models developed recently in the literature, including models with amplification effects of financial constraints, models with households' leverage constraints, and models with financial networks. We also construct an illustrative model for those readers who are unfamiliar with the literature. Within this framework, we highlight several important limitations of local solution methods compared with global solution methods, including the fact that local-linearization approximations omit important nonlinear dynamics, yielding biased impulse-response analysis.
Vu, Jonathan T., Benjamin K. Kaplan, Shomesh E. Chaudhuri, Monique K. Mansoura, and Andrew W. Lo (2022), Financing Vaccines for Global Health Security, Journal Of Investment Management 20 (2), 51-67.
View abstract
Hide abstract
Recent outbreaks of infectious pathogens such as Zika, Ebola, and COVID-19 have under-scored the need for the dependable availability of vaccines against emerging infectious diseases (EIDs). Prior to the COVID-19 pandemic, the cost and risk of R&D programs and uniquely unpredictable demand for EID vaccines discouraged many potential vaccine developers, and government and nonprofit agencies have struggled to provide timely or sufficient incentives for their development and sustained supply. However, the economic climate has changed significantly post-pandemic. To explore this contrast, we analyze the pre-pandemic economic returns of a portfolio of EID vaccine assets, and find that, under realistic financing assumptions, the expected returns are significantly negative, implying that the private sector is unlikely to address this need without public-sector intervention. However, in a post-pandemic policy landscape, the financing deficit for this portfolio can be closed, and we analyze several potential solutions, including enhanced public–private partnerships and subscription models in which governments would pay annual fees to obtain access to a portfolio of stockpiled vaccines in the event of an outbreak.
View abstract
Hide abstract
Economic shocks can have diverse effects on financial market dynamics at different time horizons, yet traditional portfolio management tools do not distinguish between short- and long-term components in alpha, beta, and covariance estimators. In this paper, we apply spectral analysis techniques to quantify stock-return dynamics across multiple time horizons.Using the Fourier transform, we decompose asset-return variances, correlations, alphas, and betas into distinct frequency components. These decompositions allow us to identify the relative importance of specific time horizons in determining each of these quantities, as well as to construct mean-variance-frequency optimal portfolios. Our approach can be applied to any portfolio, and is particularly useful for comparing the forecast power of multiple investment strategies. We provide several numerical and empirical examples to illustrate the practical relevance of these techniques.
Poggio, Tomaso, Andrew W. Lo, Blake LeBaron, and Nicholas T. Chan (2001), Agent-Based Models of Financial Markets: A Comparison with Experimental Markets, Working Paper.
View abstract
Hide abstract
We construct a computer simulation of a repeated double-auction market, designed to match those in experimental-market settings with human subjects, to model complex interactions among artificially-intelligent traders endowed with varying degrees of learning capabilities. In the course of six different experimental designs, we investigate a number of features of our agent-based model: the price efficiency of the market, the speed at which prices converge to the rational expectations equilibrium price, the dynamics of the distribution of wealth among the different types of AI-agents, trading volume, bid/ask spreads, and other aspects of market dynamics. We are able to replicate several findings of human-based experimental markets, however, we also find intriguing differences between agent-based and human-based experiments.