On the Custom Fields page you can delete custom fields by clicking on the cross icon next to the custom field.