That requires enough people I follow to where I need an outside entity to do the filter.

I think a big problem is the use case. Most social media sites are account led, not community led. This naturally makes it harder for users to find accounts outside their social circle.

The algorithm got added to fill the void.