Trust me, there's no point in hoarding old versions to see all the bugs removed features.
But in any case, there should be no technical difficulties. Just copy the older version anywhere you want before updating on Steam.