Dear @Al Hussain,
Thank you for sharing your question with the Wefugees Community!
Do I understand correctly, that the BAMF gave you a deportation ban according to § 60 Abs. 5 or Abs. 7 AufenthG? This would mean that the Ausländerbehörde issued a residence permit according to § 23 Abs. 3, right?
In contrast to the "Duldung " (§60a Aufenth), the years you were holding the residence permit (and also the time you were still in the Asylum procedure) should be counted in case you want to apply for a permanent residence permit (Niederlassungserlaubnis).
For more details on the requirements for the permanent residence you may want to check, for example, this thread, in which we discussed the topic already.
I hope this helps and please feel free to get back to us with any further questions.
All the best,
Meike