The Fifth Doctor unraveled it when looking for the Zero Room in "Castrovalva". He lamented not having in During Time Flight.
Although he has more of those. The Tenth Doctor wore one briefly when searching for a new outfit.
A page from River Song's diary from the Eternity Clock, says that the Fourth Doctor had an entire room full of scarfs.