What happens to future-me is kinda irrelevant (and also depends on how time travel works). The past me is being affected by events they did not do or know about (through future me). The line doesn’t go backwards.