Exploring LLM Cryptocurrency Trading through Fact-Subjectivity Aware Reasoning
Abstract: While many studies show that more advanced LLMs excel in tasks such as mathematics and coding, we observe that in cryptocurrency trading, stronger LLMs sometimes underperform compared to weaker ones. To investigate this counterintuitive phenomenon, we examine how LLMs reason when making trading decisions. Our findings reveal that (1) stronger LLMs show a preference for factual information over subjectivity; (2) separating the reasoning process into factual and subjective components leads to higher profits. Building on these insights, we propose a multi-agent framework, FS-ReasoningAgent, which enables LLMs to recognize and learn from both factual and subjective reasoning. Extensive experiments demonstrate that this fine-grained reasoning approach enhances LLM trading performance in cryptocurrency markets, yielding profit improvements of 7\% in BTC, 2\% in ETH, and 10\% in SOL. Additionally, an ablation study reveals that relying on subjective news generates higher returns in bull markets, while focusing on factual information yields better results in bear markets.\footnote{Code is available at \url{https://anonymous.4open.science/r/FS-ReasoningAgent-B55F/}}
Paper Type: Long
Research Area: NLP Applications
Research Area Keywords: NLP Applications,Language Modeling,Interpretability and Analysis of Models for NLP
Contribution Types: NLP engineering experiment
Languages Studied: English
Submission Number: 162
Loading