We wore them for the whole of our Nova Scotia trip
last fall. No jacket mod necessary. I don't notice when I'm wearing it... if I ride without it, I notice.
I wear it whenever I go for "a ride". If I'm moving the bike to the other side of the street for alternate side parking, I don't wear it. If I'm riding to do errands in the city, I don't wear it, but if I'm getting out the pants, and the boots, it's on as well.