You can cancel at anytime up until you punch in the PIN number on collection.
Plus you said the car was on order anyway by the dealer, so it’s not a factory order.
Dealers can be a bit pushy, but if there is a problem it’s down to the dealer not yours.