If this were true you'd be able to remove 97% of your brain without noticeable changes to your mental or physical capacity.
As Avenger said, we need all of our brain, for various functions, just not necessarily at the same time. If we didn't need it, it probably wouldn't be there. E.g. You...