Both Camber and Caster gets set at the top of the strut but that is in relation to the ball joints too.
They have to float the wheels on ball bearing plates and bouncing the car a little helps to settle things in.

I was wondering if you are aware that there is a left and a right ball joint unit. You said you rechecked the part numbers and they should look opposite when compared.

When looking from the front of the car and around the tire, the arm that comes away the control arm to the pivot should have its angled edge facing forward or towards you! This is on both sides!

I think the pivot joint has to be seated all the way up into the mounting plate that attaches to the strut. Of course that fastener is up inside the strut tube now. It sounds like it's not all the way up in that plate or that rubber boot would be squashed. It starts out an inch high and is mashed down to three quarters of an inch.

There is one other snafu in the mix besides being opposite. That is they made ball joints for cars without power steering. I do not know what the difference is other than they are identical as a book I have calls for two of them with the same part number. You may need to look at all those numbers closely and see what they sold you in crossed over brands offered.

If you have Volvo's parts the numbers are 1330 821 (left) and 1330 820 (right). A Moog number for the left is VV-BJ-5292-OE or a 45-BJ-5292 is on the ONE box I have. These are power steering numbers.

Hope this helps.
Phil