best ball mill strategy smoothing

I am machining a 3D wood surface and I'm having a really hard time getting a smooth finish. I did a rouging pass with a 3/8 ball mill leaving .004 material. I've tried following it with smoothing pass but my results are not very good (see attached.) I've tried using the 3/8 ball bit, 1/8 ball ...