custom field names seem to be displayed always when you choose to show a custom field in calendar view. Even if a particular task does not have a value for this custom field.

So to remove the clutter the custom field should only be displayed when there is actually a value for it. Otherwise do not display anything.