Baynard's Castle LondonMap ref:

This was the counterpart to the Tower of London on the Fleet Street side of London (just under St Paul's on the west side of the city wall).

Burned down in the Great Fire of 1666 and never rebuilt, but it was an important royal residence at one time (Richard III for example).


link