There's no problem with the port mismatch -- leave it alone.

Dropping the jets a couple of flats is a good diagnostic, but not a proper solution. If going over-rich at idle cures hesitation in the midrange, that would indicate that different needles are in order. Economy won't suffer -- you'll be using less gas pedal than you would trying to overcome the stumbling.

Another factor is the weight of oil in the dashpots. If the stumble only happens while you're opening the throttle and not at any steady throttle opening, that just means you need heavier oil. For some reason, many people use ATF in there, which is almost always too light.