Have you ever consider that when the comment of your brothers and sisters was made in the bible, our Lord Jesus was only 12 years old. You think a child of 12 wold already have 3 brothers and sisters (more than 2)? if so, you think they will be old enough to walk back that long journey to look for their brother? If so how could this your statement be correct "James, Joses, Simon, Judas, and His sisters were the children of both Mary and Joseph".
You also said that brother is referred to as "nationality" in
Acts 22:1, and spiritual life in
Romans 1:13" So why can't it be assumed to be so in the case of our Lord,s brother and sister since there s no portion of the bible that says "and Mary had other children.