Honestly, if it actual voters mattered and the number of soldiers and what individuals could do mattered, Canada could just easily accept defectors from the US. No American is going to raise arms against neighbors to the North. Every other American would hate that person.