Technically, there is no reason not to use aluminium. From the comments, cardboard is the standard material and aluminium could be against safety rules (due to uncontrolled landings, potentially on your head). Check your local regulations.
To see if aluminium is technically possible, the altitude is not important, speed is.
In airplanes, aluminium is usable up to cruise speeds of about Mach 2.2 (at high altitudes). Above that, the airframe heats up too much and the aluminium will start to soften. But it takes time for the fuselage to heat up, so you can get away with higher speeds for short flights.