Passport at 8 weeks

My little boy is only 8 weeks old and is ready to see the big world. It feels odd that he has a Swedish passport though. I'm Australian and have a Swedish son. I will have to apply for his Australian passport too but for now we are ready to explore as a family and I couldn't be more excited!