What is the horsepower of your bike? And how much do the bar ends weigh? Can you really feel the power difference enough to remove them?
Sounds like nothing but bench racing "I've dropped more grams than you" thinking rather than any kind of real world power/weight ratio difference. Heck, I lose more bike weight when I take a dump than I would with removing bar end weights.