In examining Jesus's pray about ALL THOSE THAT THE FATHER HAS AND WILL GIVE HIM.... we can clearly see- He was not speaking to the Masses or those that "join themselves to Him" butdo not belong to Him.
Jesus was very clear on Who The Father Sent to Him and was adamant about protecting them- till such time they inherit the Kingdom given to them.
Take a Listen to Jesus's Prayer- Like Music to our ears:
"Neither pray I for these alone, but for them also which shall believe on me through their word;
That they all may be one; as thou, Father, art in me, and I in thee, that they also may be one in us: that the world may believe that thou hast sent me.
And the glory which thou gavest me I have given them; that they may be one, even as we are one:
I in them, and thou in me, that they may be made perfect in one; and that the world may know that thou hast sent me, and hast loved them, as thou hast loved me.
Father, I will that they also, whom thou hast given me, be with me where I am; that they may behold my glory, which thou hast given me: for thou lovedst me before the foundation of the world.
O righteous Father, the world hath not known thee: but I have known thee, and these have known that thou hast sent me.
And I have declared unto them thy name, and will declare it: that the love wherewith thou hast loved me may be in them, and I in them"