Doesn't this image remind you of something?
In my opinion, before Goku was in the picture, Vegeta, was indeed, a one man mafia, this guy had ties in-between Frieza's minions, the Ginyu Force, and so many other Saiyans. He knew many people, and had reputation as a weakling from his home...