An option to remove from searching lists already added apps

[wwarlock]

For example I've created folder "Tools", pressed "+" then found and added all my tools into that folder.
After that I've created folder "Games", pressed "+" and what I'm seeing?
Right, all the tools I've already added.
So, I need an option which removes all already added apps from searching lists.
The option because in some rare situation some apps required to be added to several folders.