WHAT THIS BILL REGULATES · 1 REQUIREMENT TYPE
How Is This Bill Enforced
Verbatim statutory text on the left; plain-language analysis and a per-section checklist on the right. Numbered markers cross-link to the matching checklist row.
This Act may be cited as the ''Justice in Forensic Algorithms Act of 2024''.
This section establishes the short title of the bill as the Justice in Forensic Algorithms Act of 2024. It creates no compliance obligations.
(a) 1 Not later than 1 year after the date of enactment of this Act, the Director of the National Institute of Standards and Technology shall establish a program to provide for creation and maintenance of standards for testing computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1), to be known as the Computational Forensic Algorithm Testing Standards, consistent with the following:
(a)(1) 1 Testing standards shall include an assessment for the potential for disparate impact, on the basis of race, ethnicity, socioeconomic status, gender, and other demographic features.
(a)(2) 1 Testing standards shall address— (A) the underlying scientific principles and methods implemented in computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1); and (B) requirements for testing the software including the conditions under which it needs to be tested, types of testing data to be used, testing environments, testing methodologies, and system performance statistics required to be reported including— (i) accuracy, including false positive and false negative error rates; (ii) precision; (iii) reproducibility; (iv) robustness; (v) sensitivity; and (vi) system failure rates; (C) requirements for publicly available documentation by developers of computational forensic software of the purpose and function of the software, the development process, including source and description of data used to develop the tool, and internal testing methodology and results, including source and description of testing data; (D) requirements for laboratories and any other entities using computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1) to validate it for use, including to specify the conditions under which the lab has validated it for their use, requirements for what information needs to be included in a public report on the lab or other entity's validation, and requirements for internal validation updates when there are material changesMaterial changeThe term "material change" means an update to computational forensic software that may affect the performance measures defined in the Computational Forensic Algorithm Testing Standards or the use or output of the software.Section 2(h)(2) to the software; and (E) requirements for reports provided to defendants by prosecution produced documentation the use and results of computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1) used in individual cases.
(a)(3) 1 Testing standards shall be issued as a rulemaking under section 553 of title 5, United States Code.
(a)(4) 1 The Director shall consult with outside experts in forensic science, bioethics, algorithmic discrimination, data privacy, racial justice, criminal justice reform, exonerations, and other relevant areas of expertise identified through public input.
This subsection directs the Director of NIST to establish, within one year of enactment, the Computational Forensic Algorithm Testing Standards — a comprehensive framework governing how computational forensic software must be tested before use in criminal proceedings. The standards must include disparate-impact assessment across race, ethnicity, socioeconomic status, and gender; must address the underlying science, testing methodologies, and required performance statistics (accuracy, precision, reproducibility, robustness, sensitivity, and failure rates); must require developers to publish documentation of the software's purpose, development process, data sources, and internal testing; must set requirements for laboratory validation; and must specify content requirements for prosecution-produced reports to defendants.
The standards must be issued through notice-and-comment rulemaking under the APA. NIST must consult with outside experts in forensic science, bioethics, algorithmic discrimination, data privacy, racial justice, criminal justice reform, and exonerations.
(b)(1) 2 There shall be no trade secret evidentiary privilege to withhold relevant evidence in criminal proceedings in the United States courts.
(b)(2) Nothing in this section may be construed to alter the standard operation of the Federal Rules of Criminal Procedure, or the Federal Rules of Evidence, as such rules would function in the absence of an evidentiary privilege.
This subsection eliminates the trade secret evidentiary privilege in federal criminal proceedings. No party may invoke trade secret protections to withhold relevant evidence related to computational forensic software from the defense. The savings clause preserves the normal operation of the Federal Rules of Criminal Procedure and Federal Rules of Evidence as they would apply absent an evidentiary privilege.
(c) 3 Any Federal law enforcement agency or crime laboratory providing services to a Federal law enforcement agency using computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1) may use only software that has been tested under the National Institute of Standards and Technology's Computational Forensic Algorithm Testing Program and shall conduct an internal validation according to the requirements outlined in the Computational Forensic Algorithm Testing Standards and make the results publicly available. The internal validation shall be updated when there is a material changeMaterial changeThe term "material change" means an update to computational forensic software that may affect the performance measures defined in the Computational Forensic Algorithm Testing Standards or the use or output of the software.Section 2(h)(2) in the software that triggers a retesting by the Computational Forensic Algorithm Testing Program.
This subsection restricts federal law enforcement agencies and crime laboratories providing services to federal law enforcement to using only computational forensic software that has been tested under the NIST Computational Forensic Algorithm Testing Program. Each agency or lab must also conduct an internal validation of the software according to the Testing Standards, make the validation results publicly available, and update the internal validation whenever a material software change triggers retesting by the NIST program.
(d) 4 The Director of the National Institute of Standards and Technology shall establish a Computational Forensic Algorithm Testing Program, whose activities include the following: (1) Testing individual software programs using the testing requirements established in the Computational Forensic Algorithm Testing Standards. (2) Using realistic sample testing data similar to what would be used by law enforcement in criminal investigations in performing such testing, including incomplete and contaminated samples. (3) Using testing data that represents diversity of racial, ethnic, and gender identities and intersections of these identities in performing such testing. (4) Using testing data that tests the limits of the software and demonstrates the boundaries of reliability described in the performance measures defined in the Computational Forensic Algorithm Testing Standards in performing such testing. (5) Publishing the results of testing the software online including results under conditions specified in the testing standards and across diversity of racial, ethnic, and gender identities and intersections of these identities in a publicly available format.
This subsection directs NIST to establish the Computational Forensic Algorithm Testing Program, which will test individual computational forensic software products under the standards established in Section 2(a). Testing must use realistic sample data — including incomplete and contaminated samples — and must incorporate diversity across racial, ethnic, and gender identities. The program must also test the boundaries of each software's reliability and publish all results online, including cross-demographic performance data.
(e) 5 Retesting shall be conducted when a material changeMaterial changeThe term "material change" means an update to computational forensic software that may affect the performance measures defined in the Computational Forensic Algorithm Testing Standards or the use or output of the software.Section 2(h)(2) is made to the software that impacts its performance and may affect its outputs. The Director shall establish requirements for determining whether changes are material or nonmaterial.
This subsection establishes the retesting trigger: computational forensic software must be retested whenever a material change is made that impacts performance and may affect outputs. NIST is directed to establish requirements for distinguishing material from nonmaterial changes. This is a short but operationally significant provision that determines when software must re-enter the NIST testing pipeline.
(f) 6 Any results or reports resulting from analysis by computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1) shall be provided to the defendant, and the defendant shall be accorded access to both an executable copy of and the source code for the version of the computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1)—as well as earlier versions of the software, necessary instructions for use and interpretation of the results, and relevant files and data—used for analysis in the case and suitable for testing purposes. Such a report on the results shall include— (1) the name of the company that developed the software; (2) the name of the lab where test was run; (3) the version of the software that was used; (4) the dates of the most recent changes to the software and record of changes made, including any bugs found in the software and what was done to address those bugs; (5) documentation of procedures followed based on procedures outlined in internal validation; (6) documentation of conditions under which software was used relative to the conditions under which software was tested; and (7) any other information specified by the Director of the National Institute of Standards and Technology in the Computational Forensic Algorithm Testing Standards.
This subsection creates two intertwined obligations. First, any results or reports from computational forensic software analysis must be provided to the defendant, along with access to the executable copy, source code, earlier versions, instructions, and relevant data files. Second, prosecution-produced reports must include specified information: the developing company, the lab, the software version, change history and bug documentation, procedures documentation, use-condition documentation relative to testing conditions, and any additional information NIST specifies.
This is the bill's most directly actionable obligation for entities that develop or deploy forensic software — it requires affirmative disclosure of proprietary materials to the defense, going well beyond standard criminal discovery.
(g) 7 In any criminal case, evidence that is the result of analysis by computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1) is admissible only if— (1) the computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1) used has been submitted to the Computational Forensic Algorithm Testing Program of the Director of the National Institute of Standards and Technology and there have been no material changesMaterial changeThe term "material change" means an update to computational forensic software that may affect the performance measures defined in the Computational Forensic Algorithm Testing Standards or the use or output of the software.Section 2(h)(2) to that software since it was last tested; and (2) the developers and users of the computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1) agree to waive any and all legal claims against the defense or any member of its team for the purposes of the defense analyzing or testing the computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1).
This subsection creates an evidentiary admissibility gate: in any federal criminal case, evidence produced by computational forensic software is admissible only if the software has been submitted to the NIST testing program with no unresolved material changes since last testing, and the developers and users agree to waive all legal claims against the defense team for analyzing or testing the software. This is the bill's primary enforcement mechanism — non-compliant forensic software evidence is simply excluded.
(h)(1) The term ''computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1)'' means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.
(h)(2) The term ''material changeMaterial changeThe term "material change" means an update to computational forensic software that may affect the performance measures defined in the Computational Forensic Algorithm Testing Standards or the use or output of the software.Section 2(h)(2)'' means an update to computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1) that may affect the performance measures defined in the Computational Forensic Algorithm Testing Standards or the use or output of the software.
(h)(3) The term ''nonmaterial changeNonmaterial changeThe term "nonmaterial change" means an update to computational forensic software that does not affect the performance measures, use, or output of the software.Section 2(h)(3)'' means an update to computational forensic softwareComputational forensic softwareThe term "computational forensic software" means software that relies on an automated or semiautomated computational process, including one derived from machine learning, statistics, or other data processing or artificial intelligence techniques, to process, analyze, or interpret evidence.Section 2(h)(1) that does not affect the performance measures, use, or output of the software.
This subsection defines three terms used throughout the bill: computational forensic software (the covered platform — AI-driven software used to process, analyze, or interpret evidence), material change (an update that may affect performance measures or outputs, triggering retesting), and nonmaterial change (an update that does not affect performance, use, or output). These definitions are the interpretive keys for determining when retesting is required and what software falls within the bill's scope.