Tank, if you hold down the "alt" key while typing "0186", you will get the degree sign: 32ºF.
There are a whole raft of non-standard characters available through this, including square and cube exponents, basic fractions, and foreign letters/accent marks.
eta: You can find a complete list of characters and keystrokes here: Start > Programs > Accessories > System Tools > Character map.