Need a list to show all items when the filters don’t apply

I currently have a list with filters assigned to it.

Filters are added by using a many-to-many relationship, when a filter button is pressed an “item” is added to the user. The filters work fine however I need to list to show ALL items when the filter items are removed from the user.

I can only seem to get either the full list by removing the filers, or an empty list when the filters are not selected.

Any thoughts?