From Old English eald (“old”) + burh (“stronghold, fortress”). Doublet of Aldeburgh and Oldbury. Compare Oldenburg.
Aldbrough