My problem with an ebike is that I go too far. When I used my manual mtb I would go half as far as my ageing body would permit so that I knew i could get home without dying of exhaustion. I could go out for an hour in these parts and get plenty of exercise going only six or seven miles (on an average ride out on local roads I would generally expect to climb between 600 and a 1000 metres, such is the terrain around here). Now, I just go out with no real idea where I am going to go, safe in the knowledge that if I've left enough for 15 minutes of turbo mode (to get me back up the long, steep hill to my house) I can just disappear off for two or three hours and maybe do 25 or 30 miles and stopping in a distant pub for a pint somewhere. A 'quick ride out' never stays that way.
The only thing I regret about having an ebike is that my manual mtb is such a lovely looking machine with it's three chain rings and 26 inch wheels, the ebike with it's thick frame tubes and 29 inch wheels looks a bit 'clunky' by comparison.
Oh, and the weight, I don't like the weight of my ebike. Lifting it over stiles is a feat of strength these days as it weighs nearly twice as much as my manual bike. Looking at really expensive ebikes shows that weight is a problem on them all; still, batteries gonna weigh what batteries gonna weigh I suppose.