There are some things you can patch (or ignore altogether). But there are several scenarios when you actually need to replace drywall.