35 psi is actually on the low end for tarmac/gravel, not too high. I'd bump it slightly around 38 psi rear, 33-35 front. At your weight, running too low is the bigger problem: faster knob wear, rim damage risk, more flats.
18–20 psi on trails sounds fine, just watch for rim strikes on technical...