Herbaceous peonies need frosts on the crown for at least three weeks. Tree peonies can be grown in slightly more temperate climes such as Toowoomba – and even warmer Sydney.