I struggle with this on the daily and hope I am not alone! Would like to be able to remove Custom Fields from a Task but still keep them as a Column in List View.