3nights in Paris

I just booked 3 nights at Simons Boutique Hotel in Paris… after I read some comments about that areas safety its kinda obvious that I wont be wandering around that area that much rather the city centre and the main sightseeing locations.
Any advice how can I avoid getting involved in harassment on the way home or how can my stay be the smoothest as possible?
Im travelling with my wife.