Control
AI-only screening outcomes not recorded by race and ethnicity for the report a law requires
Where a law requires an employer that lets AI alone decide who advances to a later hiring stage to report applicants' race and ethnicity by outcome, the screening pipeline records each applicant's AI outcome (advanced or not), whether they were hired, and their self-identified race and ethnicity, and produces the periodic report from those records.
Informational data, not legal advice. Summaries and rules have not been reviewed by a lawyer: always verify official law text for decisions. A suggested guard is intended to address each rule; adding it is not a statement of compliance to that law.
Reach
enacted, not yet applying in Illinois (US-IL).
Trust and provenance
How far the rules this guard addresses have been checked. Each rule links to its provision, with its citation, official text and its own panel.
- This control
- Audit-grade: meets all 3 checks of the TwinEthos audit standard that apply to it.
- Lanes
- Binding law — not yet in force or stayed 1
- Verification
- Sources last verified 2 Oct 2026; each provision states how.
- Data release
- Data release 2026.10.03, data as of 2 Oct 2026, schema 0.3.9.
- Legal review
- None of the 1 rule has been reviewed by a lawyer; no TwinEthos rule has been legally reviewed yet. Treat each as research to check against the official text; it is not legal advice. Open questions for counsel on them: 1.
- Audit standard
- 1 of 1 rule audit-grade. The audit standard is TwinEthos's own quality bar for provenance, dates, applicability, detectors, fixtures, remediation and licences; it is not a legal review.
- Detectors
- 2 detectors, all experimental: written from the rule's text and not yet measured for precision on real code, so treat a hit as a lead to verify. Each provision lists its detectors' known limits.
The guard to add
Record each applicant's AI screening and hire outcomes with self-identified race and ethnicity, kept apart from the model's inputs, and build the required report from them.
When the AI analysis decides whether an applicant advances (for example to an in-person interview), the screening service writes an outcome row (applicant id, advanced or not, model version, date) and the hiring system later adds whether the applicant was hired. Race and ethnicity come from a separate voluntary self-identification form, are stored in their own table keyed by applicant id, and are never passed to the model. A scheduled report job joins the two for the reporting period, counts applicants advanced, not advanced and hired by race and ethnicity, and produces the file to submit before the deadline; the job's schedule and the last submission are recorded.
Where it goes: 1 application source code, 2 data models, 11 CI/CD pipeline, 12 repository artifacts.
What reviewers look for: in the module that turns the AI analysis into an advance or reject outcome, an outcome record per applicant; a self-identification table with race and ethnicity that the model's feature or prompt builder never reads; a report job or SQL that aggregates outcomes by race and ethnicity for the statutory period, with a schedule ahead of the filing deadline.
Example (Python + SQLAlchemy), before:
score = video_model.score(interview)
if score >= CUTOFF:
invite_to_in_person_interview(applicant)
else:
reject(applicant)After:
score = video_model.score(interview) # race/ethnicity never in the model input
advanced = score >= CUTOFF
screening_outcomes.insert(applicant_id=applicant.id, advanced=advanced,
model_version=MODEL_VERSION, decided_on=date.today())
invite_to_in_person_interview(applicant) if advanced else reject(applicant)
# jobs/demographic_report.py, scheduled each December
def demographic_report(period_start, period_end):
return db.execute(REPORT_SQL, {'start': period_start, 'end': period_end}) # counts by race_ethnicity x advanced x hiredEngineering guidance, not legal advice. Each provision below may add its own details (a cadence, a deadline, a required notice element): open it for those.
Every rule this guard addresses
Binding law — not yet in force or stayed (1)
- Illinois (US-IL)
- Record and report applicants' race and ethnicity when AI alone decides who gets an in-person interview (Illinois) 820 ILCS 42/20(a) · applies from 2022-01-01
Related incidents
No guardrail sits on this exact control; these incidents are cited by guardrails on related controls.
- Meta's automated moderation over-enforced Arabic and under-enforced Hebrew content (BSR due diligence) (2021-05; disclosed by the operator). An independent human rights due diligence by BSR, commissioned and published by Meta on September 22, 2022, found that during the May 2021 Israel-Palestine escalation Arabic content saw greater over-enforcement per user than Hebrew content and Hebrew content greater under-enforcement. BSR attributes this in part to Meta having an Arabic hostile-speech classifier but no Hebrew one, and to Arabic classifiers likely being less accurate for Palestinian Arabic. BSR found no intentional bias but 'various instances of unintentional bias' with different impacts on Palestinian and Arabic-speaking users. Meta committed to implement 10 of BSR's 21 recommendations and said it had since launched a Hebrew hostile-speech classifier. Source: Meta (operator response, 2022-09-22) · evidence grade: primary · cited by Check AI ranking, pricing, moderation, and ad targeting for disparities when features can stand in for protected traits, and screen every served language
- Toxicity classifiers rate African American English as more offensive (2019; confirmed). University of Washington researchers reported at ACL 2019 that tweets in African American English and tweets by self-identified African Americans were up to two times more likely to be labelled offensive by hate-speech models trained on widely used datasets, and that Jigsaw's public Perspective API showed similar racial bias, rating AAE phrases as more toxic than non-AAE equivalents. Source: Sap et al., 'The Risk of Racial Bias in Hate Speech Detection', ACL 2019 (original researchers) · evidence grade: primary · cited by Check AI ranking, pricing, moderation, and ad targeting for disparities when features can stand in for protected traits, and screen every served language
- Ride-hailing fares higher in Chicago neighborhoods with more non-white residents (researcher audit) (2018-11; alleged (not proven)). George Washington University researchers analysing Chicago's public data on more than 100 million ride-hailing trips from November 2018 to September 2019 report that trips in neighborhoods with larger non-white populations, higher poverty, younger residents and more college-educated residents were significantly associated with higher fares. They attribute this to pricing algorithms learning from demand, supply and trip duration. The finding is an observational association from census-tract data; the pricing models themselves were not examined. Source: Pandey & Caliskan, 'Disparate Impact of Artificial Intelligence Bias in Ridehailing Economy's Price Discrimination Algorithms', AIES 2021 (original researchers) · evidence grade: primary · cited by Check AI ranking, pricing, moderation, and ad targeting for disparities when features can stand in for protected traits, and screen every served language
- Google ads suggesting arrest records served more often for Black-identifying names (2012; confirmed). Harvard researcher Latanya Sweeney searched 2,184 racially associated full names on google.com and reuters.com (a Google AdSense host) from September 24 to October 23, 2012 and found ads suggestive of an arrest record appeared more often for Black-identifying first names; on reuters.com a Black-identifying name was 25% more likely to get such an ad (statistically significant). Ads appeared regardless of whether the name had an arrest record in the advertiser's database. The paper does not determine whether the advertiser's templates or Google's click-based ad optimization caused the pattern; the advertiser, Instant Checkmate, told the author it gave Google the same ad text for groups of last names. Source: Sweeney, 'Discrimination in Online Ad Delivery' (original researcher, 2013-01-28) · evidence grade: primary · cited by Check AI ranking, pricing, moderation, and ad targeting for disparities when features can stand in for protected traits, and screen every served language
Informational data, not legal advice. Summaries are TwinEthos's own words and rules have not been reviewed by a lawyer: check the official text before relying on any of it. A guard addresses an item; adding it is not a statement that your code meets any law.