That depends on where you are living in Germany. In Berlin there is no need anymore that the Ausländerbehörde asks the Bundesagentur für Arbeit. Before they had to make sure that there is no German or EU-citizen that could do the job as well (which is still the case in other federal states). Now they only check the content of your work contract with a focus on the working conditions. So here in Berlin the procedure is quicker than elsewhere.
Keep in mind that it is always the Ausländerbehörde that decides if you are allowed to work or not. Except for those people that have the comment “jede Beschäftigung erlaubt” in their papers.
In other cases, for example when you have an Aufenthaltsgestattung, it might say “Praktika gemäß Mindestlohn gestattet”. Than you can do (paid) internships. Or it says “Arbeit nach Erlaubnis der Ausländerbehörde”. So you are allowed to work, but you have to go to the Ausländerbehörde with your contract first.