How do I remove any reside if there is any?

Just take a soft cloth and dab it lightly with your $2 bottle of guitar cleaner and give it a light wipe. You should wipe your fretboard at least once every couple of months regardless because the oils on your fingers are transferred to the fretboard.

If you hold your guitar under a light you will see the oils near the frets. The most opportune time to clean your guitar is between string changes when the fretboard is fully accessible.

Guitar cleaners are good because they also recondition the wood by adding back the original oils in the wood.