A few days ago, I asked how constraints like $A^T A = I$ can be implemented if one wishes to integrate differential equations of the form $\dot{A}=f(A,t)$. Kirill was so kind to point out that a projection step on the Stiefel manifold after one integration step (for example after one Runge Kutta step) is sufficient to get the correct solution. This projection $\pi(A)$ can be found via the polar decomposition of the matrix $A$.
Now my question is, why a projection after one full RK step is sufficient. If one uses, for example, a 4th order RK method then intermediate sampling points are used. These intermediate points do not necessarily fulfil the constraint $A^T A = I$. Why do I not have to reorthogonalise the matrix A after one intermediate step but only after a full RK4 step? Is this still a valid 4th order method or is there an additional error introduced because the constraint is not fulfilled at the intermediate sampling points?
Papers like the one from Higham (1997) seem to indicate that it is perfectly fine to use any one-step method between the projections on the manifold and no accuracy is lost. I do not see the reason why this is true.