Is it possible to delete a rating you gave by accident?

I was trying to touch the "who rated this post" number and accidentally rated a post 5 stars.  Is there a way to not leave any rating after you have rated a post?  Not a big deal really.  I'm only curious because it seems you can change your rating after making it.  But there's no button to delete an accidental rating.