Make sure your references are providing accurate information about you. If you hear that they are not describing you accurately, ask for the opportunity to help them get to know who you are currently.
It may not help to take that person off your reference list; people may still call them. It is much better to help them know you as you are now.
If you have made a life change or worked on a personality trait, make sure your references know that. Tell them to please stress that point when someone calls them as a reference. They can say, “When calling others you may hear that he was an arrogant kid. He has worked on that a lot and now is a real team player.” “She had a rough patch as a teenager. That was years ago. She has really grown from that experience. Now she mentors younger girls in that area.”
Hopefully, the one doing research will call at least one of your references and can get a better picture of who you are now.