Shabbat Shalom! They are not scared per se. They have to divulge the presence of the Fallen ones. These are not from the Most High. The Fallen ones have to make an appearance. In the time of Noah, humans on Earth knew about them, nowadays those who know are us Hebrews and we don't call them Aliens.