Whenever I hear the story of Adam's rib I can't help but think to the time when women were considered the property of men in many places in the world. I know that sounds like modern, feminist spin, but I don't mean it that way. I am thinking more in the traditional way, before the modern world started equalizing the social status of the genders.
Eve being made from Adam's rib implies she is deeply connected to the man, and her very existence is owed to the man's purpose. In other words, the woman is there as a character role to further the plot of the man. We see this EVERYWHERE in modern literature, movies, etc. Woman often have trivial supportive roles in movies who are just there to further the man's role, but we never really learn much about the woman herself. The Bible seems to do this.
Also, what happened to Lilith? And Sarah? There were other women in the garden. There were also, potentially, multiple "Adams" depending on how you interpret the Bible, so there may have even been more men.