How to fire validation rule only in update operation in Salesforce?

Use NOT(ISNEW()) to fire validation rule only in update operation in Salesforce.

Sample Validation rule:
AND(
NOT(ISNEW()),
ISCHANGED(City)
)