Idle speed is dictated by the ECU and the idle air control valve.
When adjusting your throttle cable, adjust it to take out any slack. I try to set it so it's right on the cusp of cracking the throttle when there's some input on the pedal.
Sounds like you might need to lubricate the throttle...