Why Sentiment Moves Markets
Prices are set by human decisions, and human decisions are influenced by narratives, emotions, and information asymmetry. A company can have identical fundamentals on Monday and Tuesday, but if a major analyst upgrades the stock on Tuesday morning, the narrative shifts and the price responds.
Sentiment analysis quantifies this narrative layer using natural language processing. Instead of reading 10,000 news articles and 500,000 social media posts per day — which no human can do — NLP models process them in real-time and output structured sentiment scores.
The academic evidence for sentiment as a predictive signal is robust. Tetlock (2007) demonstrated that the pessimism level in Wall Street Journal columns predicted next-day market returns. Baker and Wurgler (2006) showed that aggregate investor sentiment predicted cross-sectional stock returns over months. The signal is real — the challenge is measuring it accurately and acting on it correctly.
NLP for Financial Text — From Keywords to Embeddings
First-generation sentiment analysis used keyword dictionaries: count positive words, count negative words, compute a ratio. The Loughran-McDonald financial dictionary (2011) improved on generic dictionaries by recognising that words like 'liability' and 'risk' have neutral or positive connotations in financial contexts despite being negative in general language.
Modern approaches use transformer-based language models fine-tuned on financial text. These models capture context, negation, sarcasm, and domain-specific meaning that dictionaries miss. 'Revenue missed expectations by a narrow margin' and 'revenue catastrophically collapsed' both contain the word 'revenue' and negative sentiment — but the magnitude is radically different.
The Sentiment agent in the AI Trading Copilot uses a fine-tuned model that processes earnings call transcripts, analyst reports, central bank communications, and financial news. It outputs not just a sentiment score but a confidence level and the specific themes driving the sentiment (growth, margins, guidance, competitive position).
Financial-specific language models consistently outperform general-purpose sentiment tools on financial text. The Loughran-McDonald dictionary was a breakthrough precisely because generic NLP tools misclassified 74% of negative financial sentences.
Source Credibility Weighting
Not all sources are equal. A Reuters report carries different informational weight than an anonymous Reddit post. The system assigns credibility scores based on source type, historical accuracy, and potential conflicts of interest.
Institutional research from major banks and independent research firms receives the highest credibility weight. Major news wires (Reuters, Bloomberg, AP) receive high weight. Financial media (CNBC, FT) receives moderate weight. Social media receives low base weight, but this is adjusted upward for accounts with proven track records — a well-known sector analyst on X/Twitter may have higher credibility than a generic news outlet.
The weighting prevents the system from being overwhelmed by high-volume, low-quality social media noise. A thousand bearish Reddit posts cannot outweigh a single credible earnings report — because the credibility-weighted aggregate sentiment correctly reflects the informational landscape.
Contrarian Signals: When Extreme Sentiment Reverses
The most valuable sentiment signals are often contrarian. When sentiment reaches extreme bullish readings — universal optimism, no bears remaining, 'this time is different' narratives — the probability of a reversal increases sharply. The same applies at extreme bearish readings.
This is not mere contrarianism. It reflects a market microstructure reality: when everyone is already bullish and positioned long, there are no remaining buyers to push prices higher. Any negative surprise triggers a crowded exit. The sentiment extreme itself doesn't cause the reversal — it creates the conditions where a catalyst has outsized impact.
The Sentiment agent tracks sentiment z-scores — the current reading's deviation from its rolling mean. Readings beyond +2 or -2 standard deviations are flagged as 'extreme' and contribute to the signal with reversed polarity. Extreme bullishness becomes a bearish input to the consensus model, and vice versa. This contrarian overlay has historically improved the system's performance at major turning points.
Real-Time Processing Architecture
The Sentiment agent processes data from multiple streams: financial news APIs (aggregating 50+ sources), social media firehose (filtered by relevance and credibility), SEC filings (8-K, 10-Q, 10-K parsing), and earnings call transcripts (real-time during earnings season).
Each item is processed through a pipeline: language detection, financial relevance classification, entity extraction (which assets are mentioned), sentiment scoring, theme classification, and credibility weighting. The entire pipeline runs in under 2 seconds per item.
The output is a time-decayed sentiment score per asset. Recent sentiment has higher weight than older sentiment, with an exponential decay half-life of 4 hours for news and 1 hour for social media. This captures the market's tendency to digest and price in information quickly while recognising that major narratives persist for days or weeks.
Integrating Sentiment into Multi-Agent Consensus
The Sentiment agent's output is one input among nine in the AI Trading Copilot's multi-agent consensus. It contributes a bull/bear probability, a confidence score, and a reasoning narrative explaining the key drivers.
Importantly, the Sentiment agent can disagree with other agents. If the Technical agent sees a strong breakout but the Sentiment agent detects extreme bullish euphoria (a contrarian bearish signal), this disagreement is surfaced to the Trader agent as conflicting evidence. The Trader agent must weigh both perspectives and explain its resolution.
The most profitable trades historically have been those where multiple agents agree — for example, when fundamentals, technicals, and sentiment all align. The most dangerous are when strong technical signals coincide with extreme sentiment, because the technical pattern may be valid but the crowded positioning creates fragile conditions for a reversal.
The Sentiment agent has a 'narrative shift' detector that flags when the dominant market story changes — such as a market moving from 'inflation fear' to 'growth concern'. These narrative transitions often precede significant directional moves.