How Do We Define "Difficult" Patients?

Receiving a referral for a patient who is described as being difficult is not uncommon for me, particularly after many years of working in what some might call "non-mainstream" areas. However, I sometimes wonder what "difficult" means when I read this descriptor. The issue came up again recently when I received a referral with this label attached.