Sir Alex Ferguson fears referee Mark Clattenburg will be forced to live the rest of his life with the 'stigma' of accused racism.