Seat covers will probably fix the issue.
Do you have pets? I have a fluffy cat and even though I don’t have him in my car, I have to use a lint roller to get his fur out because it occasionally sticks to me and my bag. It’s only ever a small bit of fur but enough that if I’m not careful, it makes my car look dirty.