Sweet Memories is a bakery operating out of a charming, historic 18th-century home.