There is a No: 8 bus service which runs from the Bay Campus to the Hendrefoelan Student Village via the Quadrant Bus Station and Swansea University. The bus drops you off in the student village and you will have to walk the remainder of the journey.
Check out the timetable for more details. Or have a look at the South Wales transport timetable.