Doesn't this image remind you of something?
In my opinion, before Goku was in the picture, Vegeta, was indeed, a one man mafia, this guy had ties in-between Frieza's minions, the Ginyu Force, and so many other Saiyans. He knew many people, and had reputation as a weakling from his home planet, and proved many of them wrong.
As soon as he got on Namek, he killed, four people, four people, single handedly. Before Vegeta only cared about Goku, he was able to hold his own against the most vicious enemies.
He got whooped by Zarbon, tried again, and killed him, and killed Dodoria, Cui, and Jeice in a matter of minutes.
Does anyone think that, the younger Vegeta is much more evil and untouchable than the newer Vegeta who only cares about nothing other than becoming better than Goku?