Hôtel de l'Oise offers relaxed rooms, some with balconies and river views. The property features a restaurant.