I agree with Pilgrim and Marie on this subject. However, I have read a few conservative preachers and commentators that lean the way you do. However, they also state that there isn't enough information to know for sure.
To me, I think the safe way to view this matter is to stick with what is clear and not speculate.
Would you not agree that when one does that, they end up understanding the matter the same way Pilgrim does?