You need better layers then. If it’s your face that’s a problem get a good scarf and angle it so your breath blows back up over your nose and cheeks.

I’ve been out and comfortable in -30°C/-20°F, but much below that and it get tricky without goggles, and boot and glove warmers.