When I try to remove a tag from a blogpost that has only one tag it doesn't work. Say I have a blogpost with the tags: test, whatever and tagalicious I can remove whatever and test but if try to then remove the last one it looks like it does until I refresh the backend page and it's still there.

You're right, this is a bug. I'll try to get time to fix it soon.