While he said he isn't calling on anyone to join him