So I finally got to Rail Crossing and walked into Captain Herve's office...
He did not bat an eye at me looting his desk, which had a nice pistol in it, and his locker, which had a key in it.
-
Upon chatting with him, he invited me to the key from his locker... but still no mention of the complimentary pistol in his desk.