This rustic summerhouse was built in 1899 by Pringle Borthwick, who did all the fine stonework at Compton. The name comes from the orange terracotta banisters and railings that bordered the summerhouse. Its perch on a hillside offered sweeping views across the estate and neighboring pastures and hills. In the early 1900s this garden area was described as an Italian Villa Garden. Balustrade, terrace, and hillside gardens are all prominent features in Italian Renaissance landscapes, as are Etruscan urns and fountains. Extensive flower beds and shrubs lined the paths from the Orange Balustrade to another formal rose garden once located near the Swan Pond.