No, it regularly does not. But when you are currently in an apprenticeship, you get a Duldung to finish the training. That is why we always recommend to start as soon as possible to look for an opportunity for an apprenticeship.
Another interesting point is the ‘3+2-rule’: If you finished a 3 year apprenticeship and you stay in the same company, you are getting a Duldung for the next two years as well. Otherwise you have 6 months to find another work in your field.