I feel like the bigger security concern here, if one needs to worry about it for their threat level that is more likely, is just like if someone knows your password, who could force me to unlock my phone via biometrics?