Yes, but you won't make any friends! Once a feature is scored, the meeples in that feature are basically useless, and will just get in the way.
The best solution is definitely to remember to move them in the first place, so that all of a sudden you 'discover' that you still have 4 meeples left.
Actually, with the
Abbey and Mayor expansion, you might really get into trouble if you forget about the wagon when you score, since there you can move it to an adjacent feature. You definitely can't leave that in play and only remember to move it later…
Also, such forgetfulness will likely lead to problems with the fairy ('Oh, I forgot to score my bonus points for the last two rounds—I want them now!')
And welcome to the forums!