So I'm not getting the same results as you for whatever reason ...
Just tried again.
Gave a thanks to a post in another thread. The button disappeared (immediately).
Removed the thanks and the button is back. (again immediately, without refreshing the page).