You are using the wrong port for the vacuum to distrubuitor. For engines with advance, the vacuum should be coming from the outter side of the throttle at idle, i.e, there should be nil vacumm supplied until you crack the throttle open.

For vacuum retard, I think you use manifold vacuum, but the retard can doesn't pull much because it is ultra stiff. Ideally, the retard only kicks in when you are heavly decelarating, it helps stop the small pops & bangs from the exhaust & it may reduce NOx. I've always disconnected vacuum retard cans, I think most people do. Ideally, it's shouldn't make any real difference, but dry old distrubutors can jag a bit, so the easy fix is to unplug.