{"id":475357,"date":"2025-09-13T11:15:00","date_gmt":"2025-09-13T18:15:00","guid":{"rendered":"https:\/\/calmatters.org\/?p=475357"},"modified":"2025-09-13T22:22:00","modified_gmt":"2025-09-14T05:22:00","slug":"ai-regulation-on-hold-again","status":"publish","type":"post","link":"https:\/\/calmatters.org\/_ko\/economy\/technology\/2025\/09\/ai-regulation-on-hold-again\/","title":{"rendered":"Why California backed off again from ambitious AI regulation"},"content":{"rendered":"\t\t\n\t\t
\n\t\t\t
\n\t\t\t\t\n\t\t\t\t

In summary<\/strong><\/p>\n\t\t\t\t\n\n\t\t\t\t\n\t\t\t\t

A bill mandating disclosure and appeals for a wide range of AI decisions was delayed until next year for the third legislative session in a row. Gov. Gavin Newsom is expected to consult on the measure.\n\n<\/p>\n\t\t\t\t\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\n\t\t\n

After three years of trying to give Californians the right to know when AI is making a consequential decision about their lives and to appeal when things go wrong, Assemblymember Rebecca Bauer-Kahan said she and her supporters will have to wait again, until next year.<\/p>\n\n\n\n

The San Ramon Democrat announced Friday that Assembly Bill 1018<\/a>, which cleared the Assembly and two Senate committees, has been designated a two-year bill, meaning it can return as part of the legislative session next year. That move will allow more time for conversations with Gov. Gavin Newsom and more than 70 opponents<\/a>. The decision came in the final hours of the California Legislative session, which ends today. <\/p>\n\n\n\n

Her bill would require businesses and government agencies to alert individuals when automated  systems are used to make important decisions about them, including for apartment leases, school admissions, and, in the workplace, hiring, firing, promotions, and disciplinary actions. The bill also covers decisions made in education, health care, criminal justice, government benefits, financial services, and insurance.<\/p>\n\n\n\n

Automated systems that assign people scores or make recommendations can stop Californians from receiving unemployment benefits they\u2019re entitled to<\/a>, declare job applicants less qualified for arbitrary reasons that have nothing to do with job performance, or deny people health care<\/a> or a mortgage because of their race<\/a>.<\/p>\n\n\n\n

\u201cThis pause reflects our commitment to getting this critical legislation right, not a retreat from our responsibility to protect Californians,” Bauer-Kahan said in a statement shared with CalMatters.<\/p>\n\n\n\t\n\t\t

\n\t\t\t\t\t\t\t

\n\t\t\t\t\tMore on AI bills in the California Legislature<\/span>\n\t\t\t\t<\/h2>\n\t\t\t\t\t\t\n\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\"California\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\n\t\t\t\t\t\t\t<\/figure>\n\t\t\n\t\t
\n\t\t\t\t\t\t

California has 30 new proposals to rein in AI. Trump could complicate them<\/a><\/h3>\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t

Bauer-Kahan adopted the principles enshrined in the legislation<\/a> from the Biden administration\u2019s AI Bill of Rights. California has passed more AI regulation than any other state<\/a>, but has yet to adopt a law like Bauer-Kahan\u2019s or like other laws requiring disclosure of consequential AI decisions like the Colorado AI Act or European Union\u2019s AI Act<\/a>. <\/p>\n\n\n\n

The pause comes at a time when politicians in Washington D.C. continue to oppose AI regulation that they say could stand in the way of progress. President Donald Trump in July released an “AI Action Plan<\/a>” calling for deregulation of the technology at the federal and state level. Earlier this year, Congress tried<\/a> and failed<\/a> to pass a moratorium on AI regulation by state governments.<\/p>\n\n\n\n

When an automated system makes an error, AB 1018 gives people the right to have that mistake rectified within 30 days. It also reiterates that algorithms must give \u201cfull and equal\u201d accommodations to everyone, and cannot discriminate against people based on characteristics like age, race, gender, disability, or immigration status. Developers must carry out impact assessments to, among other things, test for bias embedded in their systems. If an impact assessment is not conducted on an AI system, and that system is used to make consequential decisions about people\u2019s lives, the developer faces fines of up to $25,000 per violation, or legal action by the attorney general, public prosecutors, or the Civil Rights Department.<\/p>\n\n\n\n

Amendments made to the bill in recent weeks exempted generative AI models from coverage under the bill, which could prevent it from impacting major AI companies or ongoing generative AI pilot projects<\/a> carried out by state agencies. The bill was also amended to delay a developer auditing requirement to 2030, and to clarify that the bill intends to address evaluating a person and making predictions or recommendations about them.<\/p>\n\n\n\n

An intense legislative fight<\/h2>\n\n\n\n

Samantha Gordon, a chief program officer at TechEquity, a sponsor of the bill, said she\u2019s seen more lobbyists attempt to kill AB 1018 this week in the California Senate than for any other AI bill ever. She said she thinks AB 1018 had a pathway to passage but the decision was made to pause in order to work with the governor, who ends his second and final term next year.<\/p>\n\n\n\n

\u201cThere’s a fundamental disagreement about whether or not these tools should face basic scrutiny of testing and informing the public that they’re being used,\u201d Gordon said.<\/p>\n\n\n\n

Gordon thinks it\u2019s possible tech companies will use their \u201cunlimited amount of money\u201d to fight the bill next year.<\/p>\n\n\n\n

\u201cBut it\u2019s clear,\u201d she added, \u201cthat Americans want these protections \u2014 poll after poll shows Americans want strong laws on AI and that voluntary protections are insufficient.\u201d<\/p>\n\n\n\n

AB 1018 faced opposition from industry groups, big tech companies, the state\u2019s largest health care provider, venture capital firms, and the Judicial Council of California, a policymaking body for state courts.<\/p>\n\n\n\n

A coalition of hospitals, Kaiser Permanente, and health care software and AI company Epic Systems urged lawmakers to vote no on 1018<\/a> because they argued the bill would negatively influence patient care, increase costs, and require developers to contract with third-party auditors to assess compliance by 2030.<\/p>\n\n\n\n

A coalition of business groups opposed the bill<\/a> because of generalizing language and concern that compliance could be expensive for businesses and taxpayers. The group Technet, which seeks to shape policy nationwide and whose members include companies like Apple, Google, Nvidia, and OpenIAI, argued that AB 1018 would stifle job growth, raise costs, and punish the fastest growing industries in the state in a video ad campaign<\/a>.<\/p>\n\n\n\n

Venture capital firm Andreessen Horowitz, whose founder Marc Andreessen supported the re-election of President Trump, opposes the bill<\/a> in part because it imposes costs “well beyond [California’s] borders.”<\/p>\n\n\n\n

A policy leader in the state judiciary said in an alert sent to lawmakers urging a no vote this week that the burden of compliance with the bill is so great that the judicial branch is at risk of losing the ability to use pretrial risk assessment tools like the kind that assign recidivism scores to sex offenders and violent felons. The Judicial Council estimates that AB 1018 passage will cost the state up to $300 million a year. Similar points were made in a letter<\/a> to lawmakers last month.<\/p>\n\n\n\n

Why backers keep fighting<\/h2>\n\n\n\n

Exactly how much AB 1018 could cost taxpayers is still a big unknown, due to contradictory information from state government agencies. An analysis<\/a> by California legislative staff found that if the bill passes it could cost local agencies, state agencies, and the state judicial branch hundreds of millions of dollars. But a California Department of Technology report covered exclusively by CalMatters<\/a> concluded in May that no state agencies use high risk automated systems, despite historical evidence to the contrary. Bauer-Kahan said last month<\/a> that she was surprised by the financial impact estimates because CalMatters reporting<\/a> found that automated decisionmaking system use was not widespread at the state level.<\/p>\n\n\n\n

Support for the bill has come from unions who pledged to discuss AI in bargaining agreements<\/a>, including the California Nurses Association and the Service Employees International Union, and from groups like the Citizen\u2019s Privacy Coalition, Consumer Reports, and the Consumer Federation of California.<\/p>\n\n\n\n

Coauthors of AB 1018 include major Democratic proponents of AI regulation in the California Legislature, including Assembly majority leader Cecilia Aguilar-Curry of Davis, author of a bill passed and on the governor\u2019s desk that seeks to stop algorithms from raising prices on consumer goods<\/a>; Chula Vista Senator Steve Padilla, whose bill to protect kids from companion chatbots awaits the governor\u2019s decision; and San Diego Assemblymember Chris Ward, who previously helped pass a law requiring state agencies to disclose use of high-risk automated systems and this year sought to pass a bill to prevent pricing based on your personal information<\/a>.<\/p>\n\n\n\n

The anti-discrimination language in AB 1018 is important because tech companies and their customers often see themselves as exempt from discrimination law if the discrimination is done by automated systems, said Inioluwa Deborah Raji, an AI researcher at UC Berkeley who has audited algorithms for discrimination<\/a> and advised government officials in Sacramento and Washington D.C. about how AI can harm people. She questions whether state agencies have the resources to enforce AB 1018, but also likes the disclosure requirement in the bill because \u201cI think people deserve to know, and there’s no way that they can appeal or contest without it.\u201d<\/p>\n\n\n\n

\u201cI need to know that an AI system was the reason I wasn’t able to rent this house. Then I can at an individual level appeal and contest. There’s something very valuable about that.\u201d<\/p>\n\n\n\n

Raji said she witnessed corporate influence and pushback when she helped shape a report <\/a>about how California can balance guardrails and innovation for generative AI development<\/a>, and she sees similar forces at play in the delay of AB 1018.<\/p>\n\n\n\n

\u201cIt\u2019s disappointing this [AB 1018] isn\u2019t the priority for AI policy folks at this time,\u201d she told CalMatters. \u201cI truly hope the fourth time is the charm.\u201d<\/p>\n\n\n\n

A number of other bills with union backing were also considered by lawmakers this session that sought to protect workers from artificial intelligence. For the third year in a row<\/a>, a bill to require a human driver in commercial delivery trucks in autonomous vehicles failed to become law. Assembly Bill 1331<\/a>, which sought to prevent surveillance of workers with AI-powered tools in private spaces like locker or lactation rooms and placed limitations on surveillance in breakrooms, also failed to pass.<\/p>\n\n\n\n

But another measure, Senate Bill 7<\/a> passed the legislature and is headed to the governor. It requires employers to disclose plans to use an automated system 30 days prior to  doing so  and make annual requests data used by an employer for discipline or firing. In recent days, author Senator Jerry McNerney amended the law to remove the right to appeal decisions made by AI and eliminate a prohibition against employers making predictions about a worker’s political beliefs, emotional state, or neural data. The California Labor Federation supported similar bills in Massachusetts<\/a>, Vermont<\/a>, Connecticut<\/a>, and Washington<\/a>.<\/p>\n\n\n\t\n\t\t

\n\t\t\t\t\t\t\t

\n\t\t\t\t\tREAD NEXT<\/span>\n\t\t\t\t<\/h2>\n\t\t\t\t\t\t\n\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\"Newsom\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\n\t\t\t\t\t\t\t<\/figure>\n\t\t\n\t\t
\n\t\t\t\t\t\t

Newsom orders government to consider AI harm in contract rules<\/a><\/h3>\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\"Tech\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\n\t\t\t\t\t\t\t<\/figure>\n\t\t\n\t\t
\n\t\t\t\t\t\t

Tech giants are spending more than ever to shape California politics. See how much<\/a><\/h3>\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t