The "All By Yourself" question all solo travelers get?

Does anyone else get minorly aggrivated when you tell people you solo travel? They all ways say "By Yourself". I enjoy a travel buddy but I also know I would probably see 25% of the places I desires if it involved a friend living there or someone to tag along. It is a bit more expensive and requires safety planning, but is easier then people think.