I agree that it could be a rivet head or possibly a nail head that has popped off. It looks too small to be a button, even a cuff button. I find rivet heads all the time in farm fields. They often ring up like Indian Head Cents.
What makes you think the flat side is the front? Is there a design or lettering on it? I think I see two spots on your "front" picture that a loop could have been attached to. Being that small could it be a shoe button?