Premature optimization is the root of all evil.
If you are more comfortable with pixel-perfect implementation, but are afraid of its performance, then implement it and go test it. There's no better advice than this.
Having said that, I have never implemented pixel-perfect collision detection. That's because even though it's easy to implement, I never really grokked how pixel-perfect collision resolution was easy to implement. IDK, maybe it's just me, maybe it's because I have stumbled upon SAT in the process.
So, if AABB/oriented AABB and pixel perfect are out of question, I suggest you to have a look at
SAT. It works on any convex polygons AND it's really fun to implement. (You will need to decompose your concave polygons into convex ones though).