I think anyone who does not speak with an American accent should be looked at more carefully.
Well, if your objective is to weed out foreigners, looking at their passports might be more reliable. Not only do some foreigners speak with an American accent, some Americans speak with a foreign accent.