After the cutting out continued, I boiled the problem down to two points. The connector from the battery to the motor and some solder coming loose in the remote itself.
For the remote, I resoldered the loose wire so it seems to be working just fine now. To figure out if the remote is causing...