I don't think the game expects you to pick all of these. Usually, once I'm done with the oddities, I'm out. I suppose the lockers are an option for those without pickpocket or without the ability to fight the entire base. There's other places to grind loot if you're that much in need.