The Public Hotel, housed in a historic 19th-century building, offers stylish rooms, a trendy bar, and garden dining.