aerial photograph of Durham Castle, County Durham, England Great Britain UK. Durham Castle is a UNESCO World Heritage Site dating back to the year AD 1072. The Normal building was started by Waltheof, Earl of Northumbria who was an an Anglo Saxon who initially submitted to William the Conqueror. He later rebelled and William had him executed.The castle served as residence for the Bishops of Durham until 1837 when use was transferred to Durham University who still use the castle to this day.