I suggest you create a custom field and color the tasks in calendar view by this custom field. Yes it requires a bit of manual color mapping between individuals <> custom field value, but this is somethign you'd have to do anyway if using the assignee field