The Republican leader said he was concerned about the rising federal debt, telling Politico the best way to kickstart the economy is to “open it up again.”