Although what you want is technically achievable, (to have users have “preferences”), it will be very time consuming to make the workarounds necessary to achieve that goal. My strong advice for now is to build something more simple, limiting the functionality of these filters and then get feedback from your users on it.
It is easy to assume what your users may want but often, if they can still achieve what they wanted without with the bells and whistles, they tend to not miss them
Just my 2 cents