Praise be to Allaah.
The purpose of visiting is to uphold the ties of kinship and to strengthen the bonds (between family members). If the visits only serve to drive people further apart, then it is better not to visit, and to allow other means of keeping in touch to suffice, such as phone calls and the like.
But it is better to strive to deal with the causes of these feelings and problems with your aunt. (See also Question #4631).