FYI-Just to finish this thread out: I removed and disasembled the carbs, gave them a good cleaning inside and out. Set all the adjustments per the Hayne's manual, re-installed and still had the same problem but better. The idle would now only go to about 1000 RPM and no lower. The inside of the carbs. were pretty darn clean, no sign of loose throttle bushings,needles didn't look worn etc. I did have to adjust the floats a little bit, not much though.
After that I disassembled the distributor, cleaned up the weights, polished the lobes and the shaft the lobe spins on and lubed everything up.Set timing, confirm vacuum retard is working, dwell at 59. After that everything was fine, rev the engine and it would drop back to 800 RPM so all is good.
Seems like a combo of things were a little off or sticky.
Still, seems to me like a slightly rough idle but not bad, a little antenna waggle in drive but smooth when in park and neutral. Maybe normal? Not sure how smooth the idle should be.
Thanks for everyone's suggestions, definitely helped.