Operators of certain AI systems must submit periodic scheduled reports to designated regulatory authorities on system performance in live deployment. Unlike incident reporting, this reporting is routine and not triggered by a specific event. Unlike regulatory submissions, the focus is on operational metrics from production rather than pre-deployment assessments.
(b) Beginning January 1, 2028, an operator shall annually report to the Office of Suicide Prevention the items set forth in subdivision (a) with respect to the previous calendar year.
(a) On and after July 1, 2027, an operator shall annually report to the attorney general's office: (I) The number of times the operator has issued a crisis service provider referral notification in the preceding calendar year; (II) Any protocols the operator implemented to detect, remove, and respond to instances of suicidal ideation or self-harm by a user of a conversational artificial intelligence service; and (III) Any protocols the operator implemented to prevent a conversational artificial intelligence service response about suicidal ideation or self-harm actions. (b) The report required by subsection (5)(a) of this section must not include any identifiers or personal information about a user of a conversational artificial intelligence service. (c) The attorney general's office shall post on its public website data from reports submitted pursuant to subsection (5)(a) of this section. (d) For the purpose of creating a report as required by subsection (5)(a) of this section, an operator shall use evidence-based methods for measuring suicidal ideation or self-harm.
(e) BEGINNING IN JANUARY 2028, AND IN JANUARY EVERY YEAR THEREAFTER, THE ATTORNEY GENERAL SHALL INCLUDE, AS PART OF THE DEPARTMENT OF LAW'S PRESENTATION DURING ITS "SMART ACT" HEARING REQUIRED BY SECTION 2-7-203, A REPORT CONCERNING ENFORCEMENT ACTIONS BROUGHT AND CURE PERIODS OFFERED BY THE ATTORNEY GENERAL RELATED TO VIOLATIONS OF THIS PART 17, INCLUDING: (I) THE NUMBER OF ACTIONS FILED BY THE ATTORNEY GENERAL AGAINST DEVELOPERS AND DEPLOYERS, RESPECTIVELY; (II) THE NUMBER OF ACTIONS FILED BY THE ATTORNEY GENERAL AGAINST DEVELOPERS AND DEPLOYERS, RESPECTIVELY, THAT WERE COMPLETED; (III) THE NUMBER OF CURE PERIODS OFFERED BY THE ATTORNEY GENERAL TO DEVELOPERS AND DEPLOYERS, RESPECTIVELY; (IV) THE NUMBER OF CURE PERIODS OFFERED BY THE ATTORNEY GENERAL THAT WERE NOT MET BY DEVELOPERS AND DEPLOYERS, RESPECTIVELY; AND (V) THE NUMBER OF VIOLATIONS FILED BY THE ATTORNEY GENERAL AGAINST DEVELOPERS AND DEPLOYERS, RESPECTIVELY, WHERE A CURE PERIOD WAS NOT DEEMED POSSIBLE.
(b) On an annual basis, an operator shall submit a report to the Attorney General containing the following metrics for the preceding calendar year: (1) the total number of times the crisis intervention protocol was triggered; and (2) a summary of the results of the most recent compliance audit required by subsection (a).
(H) (1) ON OR BEFORE MARCH 1 EACH YEAR, BEGINNING IN 2027, AN OPERATOR SHALL REPORT TO THE OFFICE: (I) INFORMATION ON THE PROTOCOLS REQUIRED UNDER SUBSECTIONS (B) AND (C) OF THIS SECTION; (II) THE NUMBER OF TIMES THE OPERATOR HAS ISSUED A NOTIFICATION UNDER SUBSECTION (B)(2) OF THIS SECTION; AND (III) DETAILS ABOUT THE METHODS USED UNDER SUBSECTION (B)(3) OF THIS SECTION; AND (IV) ALL COMPLAINTS FILED UNDER SUBSECTION (G) OF THIS SECTION, INCLUDING THE RESULTS OF THE REVIEW OF EACH COMPLAINT AND ANY FOLLOW–UP ACTIONS TAKEN. (2) THE REPORT REQUIRED UNDER PARAGRAPH (1) OF THIS SUBSECTION MAY NOT CONTAIN ANY PERSONAL IDENTIFYING INFORMATION ABOUT A USER.
(3) ON OR BEFORE JULY 1 EACH YEAR, BEGINNING IN 2027, THE OFFICE SHALL: (I) COMPILE DATA FROM THE REPORTS SUBMITTED UNDER PARAGRAPH (1) OF THIS SUBSECTION FOR THE IMMEDIATELY PRECEDING CALENDAR YEAR; AND (II) PUBLISH THE DATA ON THE OFFICE'S WEBSITE.
(f) A licensee shall implement continuous monitoring systems for safety and risk indicators and submit quarterly performance reports including incident reports.
A licensee shall implement continuous monitoring systems for safety and risk indicators and submit quarterly performance reports, including incident reports.
Employers receiving State economic incentives shall report to the Department layoffs attributable to automation or artificial intelligence.
C. Operators shall publish a semiannual report available to the public on the number of times (i) the chatbot provided information about suicide, self-harm, suicidal ideation, harming others, or illegal activity and (ii) a mental health redirect has been provided to users.
(a) Beginning one year after the effective date of this act, an operator shall annually report to the Office of the Attorney General all of the following: (1) the number of times in the preceding calendar year the operator has issued a crisis service provider referral notification pursuant to subdivision 4193b(b)(2)(A) of this subchapter; and (2) the protocols put in place by the operator to: (A) detect and respond to expressions of suicidal ideation or self-harm by users; and (B) prohibit the companion chatbot from producing content about suicidal ideation, suicide, or self-harm with the user. (b) The reporting required by this section shall include only the information listed in subsection (a) of this section and shall not include any identifiers or personal information about users. (c) The Office of the Attorney General shall post on its website the data from a report received pursuant to this section.
(a) Beginning July 1, 2027, an operator shall annually report to the office all of the following: (1) The number of times the operator has issued a crisis service provider referral notification pursuant to Section 22602 in the preceding calendar year. (2) Protocols put in place to detect, remove, and respond to instances of suicidal ideation by users. (3) Protocols put in place to prohibit a companion chatbot response about suicidal ideation or actions with the user. (b) The report required by this section shall include only the information listed in subdivision (a) and shall not include any identifiers or personal information about users. (c) The office shall post data from a report required by this section on its internet website. (d) An operator shall use evidence-based methods for measuring suicidal ideation.