Oli Brown love is taking its toll