The Colgate Inn, established in 1925, offers charming colonial-style lodging with an on-site restaurant and lively bar.