Using the SUBSTITUTE() function in formula field we can replace value.

Sample Formula:
SUBSTITUTE(Field__c, '&', 'and')