Answer:
The heavens declare the glory of God; and the firmament shows His handiwork (Psalm 19:1).
Psalm 50:6, 147:4; Isaiah 40:26
Brendon, what a question! Yes, we know from the dates God gives us in the Bible that He did create the whole universe about 6,000 years ago. When we hear the term light-year, we need to realize it is not a measure of time but a measure of distance, telling us how far away something is. Distant stars and galaxies might be millions of light-years away, but that doesn’t mean that it took millions of years for the light to get here, it just means it is really far away!
When God created the universe, everything was already working perfectly, exactly how He wanted it to work. So, I believe the stars could be seen (however God did that) on earth as soon as God spoke them into existence. Keep enjoying the splendor of the night sky, but remember that God created it to display His glory so we could behold how wonderful and powerful our Creator really is!
Source: https://answersingenesis.org/kids/astronomy/why-are-stars-millions-of-light-years-away/