I would suggest going through the basics first.
I too agree it could be something simple such as the exhaust rattling against something, a broken baffle is certainly a possibility.
The exhaust is slung on rubber mounts, when the car is cold if you give it a shake you might be able to hear a broken baffle.
When it's cold again with a thick glove you could also cover the exhaust (only for a moment) see if the sound stops.
Anything inside the exhaust should in theory only rattle if there is airflow to move it.