AT WHAT POINT DOES A NEW INNING START?

I think it's pretty much accepted that once all possible plays are completed then the inning is over, the next starts and that in between the ball is dead. I put the ball into play at the beginning of every inning.
Let me ask this question. Can you enter players into the game during a live ball? Between innings is when defensive changes are made. So you tell me.