I’m not sure why I haven’t tried this earlier, but by default, when you git push your updates to OpenShift Online, it stops all your cartridges, builds, deploys and then restarts everything, which can take a few minutes.
OpenShift 2.0 supports a hot deploy option to minimize the amount of time that your app is down – details are in the docs here.