Were balloons really used during the civil war?

Yes. Hydrogen balloons were used by both armies for airborne observations.