Hi Loni you need to take your Residence Permits along with the Alien Passport while Travelling. Also in the EU, as the Border officials always ask of it.
and besides it's the Residence Permits that grants you the rights to travel Freely. the Passport is just for crossing the Borders and also for the verification of your identity.
Best regards
Nelly