Debt is less expensive for two main reasons. First, interest on debt is tax deductible (i.e. the tax shield). Second, debt is senior to equity in a firm’s capital structure. That is, in a liquidation or bankruptcy, the debt holders get paid first before the equity holders receive anything. Note, debt being less expensive capital is the equivalent to saying the cost of debt is lower than the cost of equity.