And yes, you should be afraid. Which is why "Islamophobia" is a very insidious term, and evil too. We know that the fear is completely rational.
There are good or decent Muslims, obviously. But that doesn't change the fact that Islam the religion contains a lot of horrible teachings, those Muslims are good or decent not because of Islam, but in spite of it.