Police say they are investigating after an FA Cup match between Haringey Borough and Yeovil Town was abandoned amid reports of racial abuse by fans.