There needs to be a faster way to remove records from a list then having to separately search them and remove through the "exclude" button method. After reviewing the information and determining the constituent is not one you wish to have on the list you should be able to delete them in place via the row functionality - either through the ... menu options, a delete icon, or a swipe on mobile devices would be nice.
This isn't about lists, but about constituents within list. It is cumbersome to exclude records from a list because you have to go in and type the names manually. If you could used the menu to exclude people from the lists, that would make life much easier. Sometimes you don't know all the names you want to exclude until they show up in your review of the list.
This echoes the "Checkboxes to quickly delete lists" idea, can they be Combined?