He used it in the context that whenever either me or my brother complained to him about something, it was because both parties usually were guilty of starting shit and just one of us was complaining about it.