A heat gun to expand the metal and a rubber mallet or block of wood with a hammer to try and tap the handle would be my least destructive suggestion. You could try and use a pry bar, but you’ll run the risk of cracking a tile.

I think I’d give my former suggestion a solid shot before trying anything that could cause damage.