Housed in a 17th-century building, De Pastorie offers fine dining.