America can see things that other people can't, like England can with his magical friends. However, instead of seeing fairies and magical animals, he sees ghosts.
That's why he's afraid of them.
Because he can't do anything but watch as people suffer over things that they could've done and can't fill with something else.