Hello @Marya
You are an EU-citizen. That's why your future husband has a right to get a residence permit that allows him to live/work within EU after the wedding. I assume that he has to apply for it at the Swedish aliens department (but since I'm not familiar with the Swedish institutions I can't tell you exactly which one is competent). Anyhow: Yes, he will be able to go to Sweden with you.
Best regards,
Thorgen