Hundreds of Kenyan youths who converted from Christianity to Islam—and then went to fight alongside jihadists in neighboring Somalia—are returning to their home churches. But these prodigal sons are not being welcomed back with fully open arms.

Instead, pastors are on high alert—with good reason. Al Shabab, an al-Qaeda affiliated militia, has begun using young men from predominantly Christian ethnic groups to attack churches.