You will achieve nothing appreciable from going to stainless. This is not coming from me, it's coming from 50 years of experience and I am not qualified to argue the point.
This is not a blanket statement as there are notable benefits such as, temp and noise control.
If you read up on the physics of exhausts there is not a lot you can do past the headers except get the exhaust out ASAP. The best option is no exhaust but since we have to have them, you then have to mitigate the damage of having something downstream of the ports. The whole design is mitigating this degradation of flow bit by bit, but every part you add does more harm by lengthening the time it takes to leave the system. So everything from the ports to the tip is a compromise and it all needs to be considered as a whole, not as individual parts. (I'm sure there are far more qualified engineering experts who would dispute this but this is as simple as I could make it from all the technical crap I've read through).
After talking with multiple experienced exhaust fabricators, for most applications there isn't a lot you can do past the headers except reduce restriction. As you eluded, there are different types of performance from different types of headers, but as stated, the factory headers are pretty good for overall.
How much does this matter in the reality of a road going car? SFA. If you like the sound and look, then you've done the best you could hope for.