There are several accommodations in breathtaking Mount Cook (3754 metres), the hotel Hermitage (very expensive for backpackers but where you can go in just for the views) and this Youth Hostel with budget beds in the communal dormitory.
From Mount Cook you can continue your journey by road to Queenstown or Dunedin, or flying to Franz Josef Glacier by helicopter with extraordinary views over the Mount Cook!