Hi @abigail.serwaah
As I understand the law on family reunification, it is possible to have your husband join you while you have § 31 residence permit. He should apply for a visa for family reunification at the German embassy in the country he is resident in.
In order to get a visa, he will have to show that he speaks A1 level of German, that you have enough income (i.e. not social welfare benefits) to cover your own and his living costs, and that you have sufficient living space for him.
Best,
Éanna