Pictures of buildings mentioned in the second edition “Suffolk” volume of “The Buildings of England” series by Sir Nikolaus Pevsner.
The Lindsey entry only has the church, St James's Chapel and a motte and bailey castle. I couldn't find the latter and it has disappeared in the third edition. So what we have here is St James's Chapel. It is surrounded by private land and has about 1 metre of passageway on two sides (East and South) with a short passageway from the road. The outside of the West facing Tudor doorway is completely inaccessible. Pevsner says of it: "Early C13, with lancet windows and a doorway with one slight chamfer. Piscina late C13 (pointed-trefoiled arch). W doorway early Tudor brick. Some photographs here:
Looking eastwards from inside:
The late C13 piscina:
Original S wall on left with access door. West wall at the end with the Tudor brick doorway from inside:
The original S wall with access door from passageway: