By: Blayne Soleymani-Pearson//November 23, 2022//
Blayne Soleymani-Pearson//November 23, 2022//

When used effectively, artificial intelligence, or 鈥淎I,鈥 can eliminate much bias in decision-making. However, when misused, AI may actually promote the same bias it should thwart.
Generally, employers use AI in the workplace through supervised machine learning (SML) during the hiring process. SML uses algorithms to analyze applicant data and recommend which candidates will likely succeed. The algorithms must be programmed with training data to make accurate recommendations.
A typical example of training data is common words in a r茅sum茅. An employer gathers the r茅sum茅s of their successful employees (鈥渂enchmark r茅sum茅s鈥), and the SML will catalog all the words and key phrases. The software then compares all applicant r茅sum茅s to these benchmark r茅sum茅s. If words from the benchmark r茅sum茅s appear in the applicant r茅sum茅s, then those applicant r茅sum茅s are 鈥済ood.鈥
The pitfalls of SML
Employers must administer SML carefully; it is too easy for SML to exclude members of a protected class. This exclusion is a consequence of skewed or limited data sets.
For example, an employer could have benchmark r茅sum茅s only from men that likely don鈥檛 have words commonly found in women鈥檚 r茅sum茅s, such as involvement in a women鈥檚 soccer league or attendance at an all-girls high school. Therefore, a woman鈥檚 r茅sum茅 that contains these examples will not register as valuable or beneficial to the job because the words 鈥渨omen鈥 or 鈥済irl鈥 doesn鈥檛 appear in the benchmark r茅sum茅s. Here, the SML hinders women from getting a job; it applies bias rather than eliminating it from the hiring process.
What the law says about SML
There is no federal law and few state laws governing employer use of SML. Both the Equal Employment Opportunity Commission (EEOC) and the Department of Justice (DOJ) have provided guidance that reminds employers of their duties under the Americans with Disabilities Act (ADA). The guidance advises employers to do several things:
Are you violating the ADA?
The EEOC and DOJ describe several instances where an employer may be in violation. One example is if there isn鈥檛 provision of a 鈥渞easonable accommodation鈥 necessary for the algorithm to rate the applicant fairly. If an employer relies on an algorithmic tool that screens out an individual with a disability, it is likely in violation. It does not matter if the screening out was intentional or unintentional; it only matters that it occurs. Lastly, an employer may be in violation if it adopts an algorithmic decision-making tool that violates the ADA restrictions on disability-related inquiries and medical examinations.
Complying with the EEOC & DOJ
There are two simple ways to ensure compliance with the EEOC & DOJ guidance and avoid an ADA violation. The first is to conduct a bias audit. A bias audit is an impartial evaluation that tests the artificial intelligence tool鈥檚 disparate impact on protected classes. Conducting a bias audit provides tangible evidence of an active attempt to comply with the guidance.
Another step is to consider whether the algorithmic tool was made with individuals who have disabilities in mind. Employers can set up a systematic process to determine the answer to this question. The process would ask questions like: was special attention made to the user interface so that it is accessible to as many individuals with disabilities as possible? Are any materials provided to applicants presented in several alternative formats? Was there a determination of whether the algorithm disadvantages individuals with disabilities?
Conducting a bias audit and considering the algorithm鈥檚 impact on people with disabilities do not guarantee compliance with the EEOC and DOJ. However, they are tangible and objective steps that can be taken to protect applicants and the company.
Preparing for future legislation
Colorado, California, and Mississippi have laws that regulate AI in the workplace and schools. Alabama established the Council on Advanced Technology and Artificial Intelligence. New York City has created a robust law that regulates automated employment decision tools for candidates and employees who reside in the city.
The national trend indicates that Oregon may see similar legislation in the future. So, what can employers do to prepare? First, seek advice from employment experts when designing or purchasing an SML. Next, ensure that any tools comply with the ADA by asking the following:
Finally, submit any proposed SML to trusted legal counsel before implementing the tool.
Blayne Soleymani-Pearson is an attorney with Barran Liebman LLP. He can answer questions about AI in hiring and other employment matters. Contact him at 503-276-2190 or [email protected].
The opinions, beliefs and viewpoints expressed in the preceding commentary are those of the author and do not necessarily reflect the opinions, beliefs and viewpoints of the Daily Journal of Commerce or its editors. Neither the author nor the 91视频 guarantees the accuracy or completeness of any information published herein.