I explicitly asked to pull the Ultra's ground plug from the socket, so this is really the only very simple change. So, no miracle, at least.No this was with turntable ground connected to ultra ground. If I disconnect ground from the ultra I get the typical buzz you'd expect without ground being connected.
This result indicates to me that the ground plug itself makes good contact to socket and grounding is OK. However, I don't see why it shouldn't work when the TT is connected to the Ultra directly, then.
Are the turntable, the Ultra and the unknown power amp all connected to the same mains outlet?
Does the power amp have a 2 pin power plug like the Ultra or a 3 pin plug?
Are you using the stock PSU with the turntable or the "High Power it" accessory PSU?
Did you try reverting the polarity of mains plugs?
And finally, when using the Pro-Ject Connect it Phono E RCA cable that came with the turntable, did you connect the end with the yellow mark to the Ultra?