Bayesian Inference, Dynamical Systems and the Brain

 

FIL Seminar Room, Thursdays 11am-1pm, 2011.

 

Useful Resources:

 

Probabilistic and Unsupervised Learning (Gatsby)

 

Theoretical Neuroscience (Gatsby)

 

Matrix Reference Manual

 

The PDF notes for each lecture contain a reference list.

 

1. Bayesian Inference, 24 Feb

 

      Bayes rule for Gaussians. Directed Acyclic Graphs

Joint Densities and Marginalisation. Medical Decision Making.

      Perception as statistical inference. Decision Making Dynamics.

      Bayesian Sensory Integration. Explaining Away.

      bayes.pdf

 

 

2.  Empirical Bayes, 3 Mar

     

      Linear Models.  Maximum Likelihood. fMRI analysis.

Delta rule learning.  Newton method.

      Weighted Least Squares. Marginal Likelihood.

MEG source reconstruction. Empirical Bayes.

      Restricted Maximum Likelihood (ReML)

 

      empirical.pdf

 

3. Sparse and Hierchical models, 24 Mar

     

      Relevance Vector Regression. Automatic Relevance Determination.

      Recurrent Lateral Inhibition. Linear predictive coding. Hebbian Learning. 

Sparse coding of natural visual images. MAP learning. Cauchy priors.

            sparse.pdf

 

            Linear Hierarchical Models. Superficial versus Deep Cortical Laminae.

            Hierarchical predictive coding. Increasing receptive field size. Simple cells.

            End Stopping. Nonlinear hierarchical models.

 

hier.pdf  (this file is too big for most browsers to embed – instead, right click and ‘save as’)

 

4. Approximate Inference, 31 Mar

 

      Information, Entropy,Source Coding Theorem, Prefix Coding,

Kullback-Liebler Divergence, Asymmetry,

      Multimodality,Variational Free Energy, Factorised Approximations,

      Mean Field Approach, Free-Form versus Fixed Form,

      Nonlinear Regression, Adaptive Step Size, Approach to Limit.

            approx.pdf

 

 

5. The Microscopic Brain, 7 Apr

 

      Linear differential equations. Matrix Exponential. Eigendecompostion.

Nodes, Saddles, Spirals, Centres. Feeback Inhibition. Stability.

Local linear stability analysis. Isoclines. Nonlinear Oscillations.

Spiking Neurons. Fitzhugh-Nagumo. Hodgkin-Huxley. Rose Hindmarsh.

Hopf and Saddle-Node Bifurcations. Type 1/2 Cells.

microscopic.pdf

 

6. The Mesoscopic Brain, 14 Apr

 

      Integrate and Fire Neurons.Phase Reduction.

      Phase Response Curves. Weakly Coupled Oscillators.

Synchronization via excitation or inhibition.

Spike Frequency Adaptation (SFA).

Spike Time Dependent Plasticity (STDP).

Dynamic pattern recognition via transient synchronisation.

Spike-to-Spike versus LFP synchronization.

      mesoscopic.pdf         

 

7. The Macroscopic Brain, 21 Apr

     

Neural Mass Model.  Alpha activity. Spike cycles. Bifurcations.

Hierarchical cortical connectivity. Delay differential equations.

Dynamic Causal Models (DCM)  for Event Related Potentials.

Auditory oddball. Linear Systems Analysis.

Network kernel function. Frequency response. Cross Spectral Density.

DCM for steady state responses. Inferring synaptic physiology.

macroscopic.pdf

 

8. Stochastic Processes, 19 May

 

      Wiener, Ornstein-Uhlenbeck (OU) and Gaussian processes.

      Stochastic Differential Equations. Stochastic chain rule.

      Mean and variance functions.

Rodriguez-Tuckwell method for multivariate Gaussian

approximation of population density evolution.

Population of Fitzhugh-Nagumo neurons.

Fokker Planck Equation. Population of stochastic integrate

and fire cells. 2AFC tasks. Drift Diffusion Models.

Reaction Times and Error Rates.

      Continuum limit of discrete time Bayesian model.

           

sp.pdf

 

9. Hierarchical Dynamic Models, 26 May

 

      OU(p) processes. Covariance functions. MEG alpha rhythms.

Embedding  and Generalised Coordinates.

Continuous time latent variable models.

      Filtering. Variational Energies and Actions.

Dynamic Expectation Maximisation. Linear Convolution Model.

Hierarchical Dynamic Models.

 

hdm.pdf

 

10. Bayesian Model Comparison, 2 June

 

      Posterior model probability, Bayes factors, Odds Ratios

      Model evidence. Free Energy. Approximation.

Accuracy and Complexity Decompositions.

AIC and BIC. Linear Models. fMRI example simulations.

DCM for fMRI example. Priors. Simulations.

      Inference for groups of subjects. Fixed Effects.

      Random effects generative model. Gibbs sampling.

      Exceedance probabilities.

 

bmc.pdf