I know that brace very well, but it doesn't foul my power steering pump. I've had to turn the power steering hose ends a few degrees to allow me to push my pump in so I can get its belt off, but I have plenty of freedom to move the pump out to the end of its adjustment travel without fouling that diagonal brace.
That alternator brace isn't symmetrical, and it can't go in either way. If the power steering pump weren't there, it probably could go in either way, but it is offset to run around the back of the power steering pump. Take it out, adjust your power steering pump's belt tension, then put the brace back in. You'll see that it fits one way and not the other. Putting it in backward is easy to do. I did that myself while converting to my "new" Bosch alternator. Honestly, that brace looks slightly superfluous, but I can see that it might help prevent the alternator bracket from racking out of alignment under tension.
Good luck,
Scott