4
$\begingroup$

The E-M algorithm does not guarantee convergence to global maxima. Following Applet shows this nicely: http://www.cs.cmu.edu/~alad/em/

Is it possible to generate data set, that guarantees reaching global maximum? Maybe few simple constraints imposed on generation process is enough to guarantee, that E-M will find global maximum?

$\endgroup$
1
$\begingroup$

Increasing the number of data points often helps reducing the number of local maxima. There is no other general recipe to avoid converging to nonglobal maxima with EM, except to ensure that these don't exist.

Or switch the method and use a branch and bound technique. It will find a globab maximum, if it has enough space and time for running to completion. But for typical statistical estimation problems this tends to happen only for fairly small problems.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.