if the neck and top are ok you can just sand off the bottom of the saddle or nut, but do it carefully and slowly. i don't think taking off 1 or even 2 mm of the saddle will affect the tone too much, but going too low will make the fret buzz.
measure the action on the 12 fret and on the 1st. then determine how much material you want to sand off from the measurements.
its also a myth that adjusting the truss rod will raise /lower the action. it does affect action but to a very small degree its job is not to control the action but to help support the neck from the string tension.