DeFine: Decision-Making with Analogical Reasoning over Factor Profiles
LLMs are ideal for decision-making thanks to their ability to reason over long contexts.However, challenges arise when processing speech transcripts that describe complex scenarios, as they are verbose and include repetition, hedging, and vagueness.E.g., during a company's earnings call, an executive might project a positive revenue outlook to reassure investors, despite uncertainty regarding future earnings.It is crucial for LLMs to incorporate this uncertainty systematically when making decisions.In this paper, we introduce DEFINE, a modular framework that constructs probabilistic factor profiles from complex scenarios.It then integrates these profiles with analogical reasoning, leveraging insights from similar past experiences to guide LLMs in making critical decisions in new situations.Our framework separates the tasks of quantifying uncertainty and incorporating it into LLM decision-making.This approach is particularly useful in areas such as consulting and financial deliberation, where making decisions under uncertainty is vital. Analogous Example Analogous Example Analogous Example Analogous ExampleSimona Jankowski (Vice President, Investor Relations): During this call, we will discuss non-GAAP financial measures.You can find a reconciliation of these non-GAAP financial measures to GAAP financial measures in our CFO commentary, With that, let me turn the call over to Colette.
Authors
- Dong Yü (ORCID: https://orcid.org/0000-0002-3412-6440)
- Hassan Foroosh (ORCID: https://orcid.org/0000-0002-7601-8165)
- Daoan Zhang (ORCID: https://orcid.org/0000-0002-6959-165X)
- Yebowen Hu (ORCID: https://orcid.org/0000-0002-3798-2437)
- Yiming Lu
- Xiaoyang Wang (ORCID: https://orcid.org/0000-0001-9332-2700)
- Wenlin Yao
- Fei Liu (ORCID: https://orcid.org/0000-0002-9814-4226)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.findings-acl.238
- Citations
- 1
- Primary Topic
- Bayesian Modeling and Causal Inference
- Type
- article
- Field-Weighted Citation Impact
- 2.48
Funders
- National Science Foundation