When I called they said I had to cancel by sending a letter.

I went through something similar while trying to cancel, only instead of a vacation it was somewhere I completely moved to that no longer had planet fitness. Going back and forward with the gym via phone and then letters went nowhere. I finally put a stop on my debit card to end things. I heard they go after people in court or collections at that point, but I was never contacted again about it.