Rules vary depending on the host country and circumstances.
Contributions to your RRSP
Check if your income outside of Canada will be eligible. If
it is not, you can't contribute to your RRSP and get a tax
refund.
If you cash in your RRSP
Check the rules. Depending on the host country, you'll enjoy
reduced tax in Canada where there is an agreement to that effect
with the other country.
In general, there is no provincial tax deduction for
non-resident.