AW11's have been known to be fairly biased towards front braking, and generally require one of various methods to resolve it if the car is to be tracked, or driven very spiritedly. One method that has worked fairly well is to do what's called 'gutting' the rear portion of the brake proportioning valve (it's been discussed in depth on mr2oc.com). It will even the front to rear bias a bit, but still leaves the fronts with significantly more braking force than the rears, which shows how uneven they are to start with. Another method would be to fit better biting rear pads. The other method is to install a separate brake proportioning valve to control the front brake bias on its own.
If you are driving a factory 4agze then you are likely to have even more of an issue with this as the rear end is significantly heavier than the N/A, making the rear even more brake resistant. Toyota used the same proportioning valve on both cars, so the 4agze ends up at further disadvantage because of that.
But before you do any of that make sure that the brake calipers/pistons have been disassembled and cleaned within the last 50-75k miles or so, as they definitely tend to gum up a bit over that duration, and will significantly affect braking.