I didn’t realize Oblivion had a fast travel system until way later

So… You didn’t read your journal? The quest that sends you to Weynon Priory as you exit the tutorial literally tells you to open the map and click on the icon there to fast travel.