to stop being part of a deal or an agreement
The bank backed out of the contract.
We had to cancel the project when our German partners backed out.