CASUAL MALE RETAIL GROUP, INC. 5% Convertible Senior Subordinated Notes due 2024 PURCHASE AGREEMENT Dated November 12, 2003