I figure the weight from up top was keeping the shelf balanced with the
weight of the clothes hanging. Once the weight on top was removed, the
clothes was just to much.


Post down to the floor at each end of the closet rod with 1x4s.
That will hold up pretty near anything.