[xīn qù nán liú]   

心    去    难    留    去：离开。心已在别处，难以挽留。

心去难留

Difficult to keep someone against his will

心劳意冗    心若死灰    心去难留    心满愿足    心腹之忧