aerial photograph of Weoley Castle Birmingham, West Midlands. Weoley Castle is actually a fortified manor house which was originally surrounded by a moat. First constructed of wood in the 13th century the castle was later rebuilt in stone with various additions and alterations throughout the middle ages.The castle fell into use some time around the 16th Century with much of the stone being scavenged for nearby farm buildings..