I have some boxers with a fake fly.  There is some fabric in the shape of a fly, but it doesn't open.

The first time I discovered this was at the urinal of a public bathroom.  It was at that exact moment that I realized you look pretty silly searching for a non-existent fly in your boxers.  

Especially when you mumble stuff like "Where is this thing?"