Yup, been saving and collecting those for 40+ years and have a stack of them plus others that were purchased at auctions like greatcollections.com
Another type of note you might look to save would be Barr dollars. Joseph Barr was only in office a short time
"A Barr dollar is a 1963B $1 Federal Reserve note signed by former Secretary of the Treasury Joseph W. Barr. Barr served as treasury secretary for only 28 days, the shortest term on record. He served from Dec. 21, 1968, to Jan. 20, 1969, and signed only the $1 bill."
Those used to be more common, but I am going from old memory. Back then the asterick was a symbol that the bill had been replaced and they re-used the S/N.
My way of messing with the treasury was to keep nickels. Actually went to trouble to get them. Had a 5 gallon bucket pretty full when it got stolen. It was heavy. www.coinflation.com for why