I just put tme sport springs and bilsteins on my v70 t5 and the difference is incredible. I had the same complaints you state and would whole heartedly recommend the switch. My car now goes around the corners in a very smooth arc. Make sure you have no worn parts in your front end as this will cause all kinds of handling problems. Easy to do. Jack up one side of the front end and try to flex the lifted tire up and down and then side to side. If the tire moves up and down you most likely need ball joints. If it moves from side to side you most likely have worn tie rod ends.
Don't settle for less than great handling. You must have some curvy roads to rip up in your area and shocks and springs will put you in the running with the best of them.