The Fisher information matrix (FIM) is a key quantity in statistics. However its exact
computation is often not trivial. In particular in many latent variable models, it is intricated due
to the presence of unobserved variables. Several methods have been proposed to approximate
the FIM when it can not be evaluated analytically. Different estimates have been considered, in
particular moment estimates. However some of them require to compute second derivatives of
the complete data log-likelihood which leads to some disadvantages. In this paper, we focus
on the empirical Fisher information matrix defined as an empirical estimate of the covariance
matrix of the score, which only requires to compute the first derivatives of the log-likelihood.
Our contribution consists in presenting a new numerical method to evaluate this empirical Fisher
information matrix in latent variable model when the proposed estimate can not be directly
analytically evaluated. We propose a stochastic approximation estimation algorithm to compute
this estimate as a by-product of the parameter estimate. We evaluate the finite sample size
properties of the proposed estimate and the convergence properties of the estimation algorithm
through simulation studies.
https://computo.sfds.asso.fr/published-202311-delattre-fim/published-202311-delattre-fim.pdf