At least that parts easy....  ha ha  And that's common for all E series boxes?
 
I'm having a bit of trouble tracking down an E53 box though, they were on the 92/93 camry and pretty rare as most were sold as auto's.
 
With the k20 conversion idea, adaptor plates are available for purchase around $300 but there seem to be issues with the flywheel spacers and starter motors.  I will keep looking into both ideas. 
 
I can't afford to have the car off the road for more than a day, my wife thinks cars are magical things that fix themselves and don't cost any money so if my car is out of action for a week or two then I have to explain myself.  :(
 
Yes, I hear the whip crack and the sound of your laughter ringing in my ears.

Does the E53 share the same chassis mounting point as the S54? IE. Will it be a direct fit replacement?

Nobody has mentioned engine mounts with the K20 box. What's the options there?

Thanks.

Thanks for all of your help and suggestions guys.