This sounds like a good time to bring up the:
Cosmology FAQ
One argument against an infinite universe is that the universe seems to be cooling, i.e. the cosmic background radiation is growing weaker over time. If the universe is truly infinite, with an infinite number of stars, it seems that the universe will only get hotter over time.