Stretch double jersey dress with rayon insert