Description: A Cruise AV ran over a fire hose that was being used in an active firefighting area.
Entities
View all entitiesAlleged: Cruise developed and deployed an AI system, which harmed San Francisco firefighters and San Francisco Fire Department.
Incident Stats
Risk Subdomain
A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
7.3. Lack of capability or robustness
Risk Domain
The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
- AI system safety, failures, and limitations
Entity
Which, if any, entity is presented as the main cause of the risk
AI
Timing
The stage in the AI lifecycle at which the risk is presented as occurring
Post-deployment
Intent
Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
Unintentional
Incident Reports
Reports Timeline
Emergency Responder Incidents
In San Francisco comments on the Draft CPUC Resolution to approve the Cruise initial advice letter, San Francisco informed the Commission of an incident on April 5, 2022 when a Cruise AV stopped in a travel lan…
San Francisco is in an uproar over robotaxis’ persistent interference with firefighters, police officers and other emergency medical personnel.
The city’s fire chief called attention Thursday to the potentially dangerous encounters between …
Variants
A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.