Dear Mr camara,
Welcome to the Wefugees Community and thank you for the very interesting question.
I was not very sure about it either and tried to make some research. First of all, in the law section 19d of the German Residence Act itself, it is not mentioning a potential revocation in case people are travelling to their countries of origin. On the website berlin-hilft.com, the authors are stating as well that it is possible to travel with that kind of residence permit.
However, I will also link two of our experts here in order to get some more opinions about it: Dear @mbeon-Rukundo or @mbeon-Christine, can you give any advice?
All the best,