well I don't think they should be entirely removed, well they do add some kind of challenge and also convince players to more organize their time add to make sure to go to bed instead of not worrying about exploring at night
But I do think it should be changed so that there is a way to avoid them like a potion or something or maybe there should be some kind of beacons that keeps phantoms away, something else to skipping night easier so maybe in one or maybe %50(or more) of players are sleeping to skip night time, but that's just an idea.
