Welcome back to the Wefugees Community and thank you for reaching out to us again.
As we discussed in one of your earlier posts, the residence permit according to section 25 (3) of the German Residence Act is granted after the BAMF issued a so-called national deportation ban (according to section 60 (5 or 7) Asylum Law. Whether you are allowed to travel to your home country Pakistan or not depends on the reason for the deportation ban - but it might get difficult. I would recommend you to discuss your individual situation with a counselling office, for instance.
However, as spouse of a German citizen you should be also entitled to receive a residence permit according to section 28 of the German Residence Act. Then, travelling to Pakistan could get possible (as @Denny28 already mentioned).
Please don't hesitate to get back to us if you have any further questions.
All the best,