Canceling Before Move-In

Scenario: House is ready Nov 15th; I give security deposit on Oct 24th and we agree I will move-in on Nov 28th. On Nov 5th, my house falls out of escrow and I cancel on place I put deposit down on. Property Management group wants me to come in and pay a lease-breaking fee of 30% of the rent (they won’t take out of deposit). Once they find new renters, I get deposit back. Does it seem right that I have to pay a lease-breaking fee if my lease did not begin until Nov 28 and I canceled on Nov 5?