In 1931 William G Swan built a rocket-powered glider used in the first rocket-powered, manned flight in the US, first flying on 4 June 1931. A second flight followed the next day. Swan also carried some mail, so it would also qualify as the first rocket-propelled air mail.
The craft was a single-place open-cockpit, high wing monoplane.