Compressor side - basically the 'big' turbos won't heat up the air as much when they produce the same compressed air at the manifold. So you have the same air pressure, same volume (manifold), so the amount of air has to change

. So *more* air makes it into the engine. Combine this fact with a more efficient (less backpressure) exhaust side, and you can see how the 'big' turbos can make more power pretty easily, but at the expense of response.
Also, a turbo like the stocker is very inefficient at higher boost levels, basically heating the air up too much as it compresses it. The larger turbos (generalizing here) can achieve higher pressure ratios without heating the air up too much.
If you look at some compressor maps you can understand this better, as the stocker has very poor efficiency past 14psi (the charge air temp increases greatly as you run > 14psi), and the larger turbos, say a TE63 or so, can run peak efficiency to at least 20psi, and still decent past that (on the right motor).