The FOCUS state is not the same as the DOWN state — I believe you want the ACTIVE state instead of HOVER.
(Your issue also occurs in my Firefox. The button will not leave the focus state until you focus on anything else specifically).
If you did intend the focus state, make sure you have your doctype declared, that’s required to make it work in IE8. In fact, it’s recommended all the time.