Quote was from my mechanic, presumably through the dealer network.
Tried Neil Jones and the other UK spares guy on Ebay. Neil mentioned that the SC AW11 is super rare in the UK, and that he's only just purchased his first one last week. Even so, he's probably going to sell the engine complete.
According to several quotes I've found, the bearing can't be replaced.
"The tensioner pulleys on the GZE are weird bearings. The bearing itself is a press fit just like all the rest. But the inner race is the same piece that gets clamped to the bracket to hold the tensioner in place. Herein lies the problem, you cant get the bearing because its a custom item made by NGK for Toyota"
That led me to Amayama.com and the part number 13570-16010.
They have a couple in stock at more reasonable prices. My only hesitation now is that the part is listed as "IDLER ASSY V-RIBBED". The pulley I'm looking for is smooth, as it runs on the opposite side of the ribbed belt.
The image searches on that part no show smooth pulleys, so I'm thinking that it's called that only because it only technically uses a ribbed belt. Kinda want to be sure before ordering anything though.