Debug libraries generally are not optimized and link against other debug libraries. In some cases the debug symbols are also included in the lib. For Visual Studio libraries however the debug symbols are exported to the PDB file.
Debug libraries allow you to easily step through your program in debug mode, while when debugging release libraries some instructions will just be jumped over.
Remember to always link against debug libraries in debug mode and release libraries in release mode!