Castle End is the place name of an area to the NE of the Parish church, but the exact site of the castle is not known. The Castle End placenames lie either side of a Roman Road leading South from Ariconium.

The name Lea comes from the Old English word 'leah', which meant 'clearing'. (Herefordshire Place Names - Copleston-Crow, BAR  British Series 214, 1989)

At the time of the Domesday Survey of Herefordshire (1086) Lea was held by the Church as a gift from Walter de Lacy. Before the Norman conquest it had been held by Ansgot.  Lea contained 1 hide which paid tax, in lordship there was 1 plough, 2 slaves and 1 smallholder. The value was 10s and there was enough land for one more plough