Well here's some possibilities: When you log out of the software, you're still technically logged in, in the sense that as the last logged in person anything that's played in the software gets credited to you. The next person would have to log in themselves in order for plays to count to them and not you.
Another possibility is that something in your collection is being mis-read as something else. That could be a metadata thing. Do you see anything in your collection that could possibly be mistaken for the item you got a badge for (maybe a group is sharing the same song title, etc).
Those are things I could think of at the moment, so let's start there.
Marques Lyons (tromboneforhire)
Zune MVP
Contributor, http://www.insidethecircle.net