I don't mind it, most of the time people are so... hmmm... amazed/surprised, lol! It becomes funny!
Sometimes, the person making a comment sticks their foot in their mouth.
Example... We headed to Friendly's one night when my oldest was about 2. My Dad and Shayne walked in first, then my mom and I. The hostess looked at Shayne and my DAD, and said (no joke) "Oh Oh, we KNOW who his Daddy is!!!" Then she smiled... My husband, who parked the car, had just come up behind us, and he said "Nope, that's his grandfather!" Her mouth dropped, and she stared, lol! It became comical at that point.
So...
My oldest looks like me - and I look like my Dad (when I'm with him, but look like my mom when I'm with her, lol). BUT... he is a mini me of my father.
My youngest looks like my DH - and his uncles. With a smidge of me in there for his looks - but lots of me personality wise. :P