Mathematical Psychology
About

Kalman Filter Models

The Kalman filter provides an optimal learning model for tracking a changing environment, with a learning rate that automatically adapts based on the relative uncertainty of predictions versus observations.

Kₙ = σ²_pred / (σ²_pred + σ²_obs)

The Kalman filter, originally developed for engineering applications, has been applied to psychological learning as a model of adaptive belief updating in changing environments. It extends Bayesian inference to sequential estimation, providing an optimal rule for tracking a hidden state that drifts over time — such as the changing reward probability in a volatile environment.

Kalman Filter as Learning Model

Kalman Filter Update Prediction: μ_pred = μ_prev, σ²_pred = σ²_prev + σ²_drift
Kalman gain: K = σ²_pred / (σ²_pred + σ²_obs)
Update: μ_new = μ_pred + K · (observation − μ_pred)
Uncertainty: σ²_new = (1 − K) · σ²_pred

The Kalman gain K plays the role of the learning rate. Crucially, K is not fixed but adapts automatically: when prediction uncertainty is high (σ²_pred large), K approaches 1 and the learner relies heavily on the new observation. When observations are noisy (σ²_obs large), K is small and the learner relies more on prior predictions. This adaptive learning rate captures the empirical finding that people learn more from surprising outcomes in volatile environments.

Psychological Applications

Kalman filter models have been applied to reward learning, social learning, anxiety (where σ²_drift may be overestimated, leading to excessive updating), and perceptual tracking. They provide a principled alternative to the fixed-learning-rate models (Rescorla-Wagner, Q-learning) and capture individual differences in learning through variation in the model's noise parameters rather than an arbitrary learning rate.

Related Topics

References

  1. Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. Journal of Basic Engineering, 82(1), 35–45. https://doi.org/10.1115/1.3662552
  2. Dayan, P., Kakade, S., & Montague, P. R. (2000). Learning and selective attention. Nature Neuroscience, 3(Suppl.), 1218–1223. https://doi.org/10.1038/81504
  3. Gershman, S. J. (2015). A unifying probabilistic view of associative learning. PLoS Computational Biology, 11(11), e1004567. https://doi.org/10.1371/journal.pcbi.1004567
  4. Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007). Learning the value of information in an uncertain world. Nature Neuroscience, 10(9), 1214–1221. https://doi.org/10.1038/nn1954

External Links