can remove the downpipes and check for excessive shaft play or a resistance to them spinning. It sounds like you have the mechanical skills and know how, but if the wheels are "wobbly" (unfortunately, you can't get a gauge on them to check the exact shaft play), they have too much shaft play and might make contact with the housing when turning. Or, the shaft might have excessive resistance to turning, indicating a partial seizing. I hate to see you put more money into fixing it before you know exactly what "it" is.