The real solution to this is to have an air return installed in the baby's room.

As you have discovered, a room without a return will be cool or cold in winter and hot in summer.

Temporary...