Why does he believe that it has nothing to do with him?

They might be attacking because of something that happened prior to his being a member of the crew, but they are still attacking now. Which means that he'd be included in that. The captain would ask and tell him this, wanting to hear his reasoning.