My only concern with that is if for some reason there's a problem
installing the new cable and we take out the old one, I won't
be able to watch tv...

Try reading some books on this instead of watching TV...

http://www.amazon.com/Data-Voice-Vid.../dp/1428334726

http://www.amazon.com/Wiring-House-P.../dp/1561585270