Yes, it is safe to shower or bathe in the water. The primary concern is that the water not be consumed. Instruct children not to put the water in their mouth when they are bathing. If you have recent surgical wounds or a chronic illness, you may want to use bottled or boiled water for bathing until the advisory is lifted.