A Roman road, which crossed from the Sussex coast to the Thames, passed near the present churchyard of St Martin.
The church of St Mary, with embattled tower and spire, is of various dates, and contains good examples of monumental work of the early 17th century; and in the churchyard is buried Robert Clutterbuck (d.
An inscription on the tomb of Thomas Abbott Hamilton in the churchyard is by the poet Cowper, who lived in the neighbouring town of Olney.
A modern cross in the churchyard commemorates St Caedmon, the Northumbrian poet (c. 670), who was a monk at the abbey and there died.
In the churchyard there is a monument to four covenanters who suffered at Edinburgh, on the 7th of December 1600, whose heads were buried here.
In the churchyard the graves are buttressed, storms being frequent and violent on this unprotected coast.
In the churchyard is the grave of William Burness, the poet's father.
A statute of 1553 made the breaking or defacing of an altar, crucifix or cross in any church, chapel or churchyard punishable with three months' imprisonment on conviction before two justices, the imprisonment to be continued unless the offender entered into surety for good behaviour at quarter sessions.
THOMAS CHURCHYARD (c. 1520-1604), English author, was born at Shrewsbury about 1520, the son of a farmer.
The church of St Nicholas has ancient portions, and in the churchyard is the tomb of William Hogarth the painter, with commemorative lines by David Garrick.