Do my referees need to be my most recent three supervisors?

Where possible, yes.

The primary concern for recruiters when seeking references is that they should be as up-to-date as possible; the purpose of seeking a reference is to ensure your candidate is suitable for the specialty, rather than to influence the decision when deciding to whom posts should be offered.

Thus a reference from a 'good' or 'notable' referee will garner no advantage to your application.