Registro de citas para el Incidente 807

Description: A child protection worker in Victoria used ChatGPT to draft a report submitted to the Children's Court. The AI-generated report contained inaccuracies and downplayed risks to the child, resulting in a privacy breach when sensitive information was shared with OpenAI.
Editor Notes: Reconstructing the timeline of events: Between July and December 2023, according to reporting, nearly 900 employees of Victoria’s Department of Families, Fairness, and Housing (DFFH), representing 13% of the workforce, accessed ChatGPT. In early 2024, a case worker used ChatGPT to draft a child protection report submitted to the Children’s Court. This report contained significant inaccuracies, including the misrepresentation of personal details and a downplaying of risks to the child, whose parents had been charged with sexual offenses. Following this incident, an internal review of the case worker’s unit revealed that over 100 other cases showed signs of potential AI involvement in drafting child protection documents. On September 24, 2024, the department was instructed to ban the use of public generative AI tools and to notify staff accordingly, but the Office of the Victorian Information Commissioner (OVIC) found this directive had not been fully implemented. The next day, on September 25, 2024, OVIC released its investigation findings, confirming the inaccuracies in the ChatGPT-generated report and outlined the risks associated with AI use in child protection cases. OVIC issued a compliance notice requiring DFFH to block access to generative AI tools by November 5, 2024.

Estadísticas de incidentes

ID
807
Cantidad de informes
7
Fecha del Incidente
2024-09-25
Editores
Daniel Atherton
translated-es-Investigation into the use of ChatGPT by a Child Protection worker
ovic.vic.gov.au · 2024
Traducido por IA

translated-es-The following is a copy of the executive summary of the report. To view the report in full, please download the PDF provided by OVIC.

Executive summary

Background

In December 2023, the Department of Families, Fairness and Hous…

Trabajador social de Victoria utilizó ChatGPT para redactar un informe de protección infantil
itnews.com.au · 2024
Traducido por IA

El Departamento de Familias, Equidad y Vivienda (DFFH) de Victoria recibió la orden de prohibir y bloquear el acceso a una variedad de herramientas de inteligencia artificial generativa después de que un trabajador de protección infantil us…

translated-es-Victorian welfare agency banned from GenAI after child protection debacle
themandarin.com.au · 2024
Traducido por IA

translated-es-Victoria’s Department of Families, Fairness and Housing (DFFH) child protection service has been banned from using generative artificial intelligence in the workplace for at least a year.

The ban comes after an investigation i…

Ordenan la prohibición de AI después de que un trabajador de protección infantil utilizara ChatGPT en un caso judicial de Victoria
theguardian.com · 2024
Traducido por IA

La agencia de protección infantil de Victoria ha recibido la orden de prohibir a su personal el uso de servicios de inteligencia artificial generativa después de que se descubriera que un trabajador había introducido cantidades significativ…

translated-es-Victorian child protection worker uses ChatGPT for protection report
cyberdaily.au · 2024
Traducido por IA

translated-es-Victoria’s child protection agency has been ordered to ban the use of AI tools after a case worker used ChatGPT to write a child’s protection report, resulting in sensitive data being submitted and a number of inaccuracies bei…

translated-es-Victoria's child protection agency bans AI use after report debacle
newsbytesapp.com · 2024
Traducido por IA

translated-es-What's the story

Victoria's child protection agency has imposed a ban on its staff using generative artificial intelligence (AI) services. This decision comes after an employee was discovered to have inputted substantial perso…

translated-es-Australian Information Commissioner Halts GenAI Use for Child Protection Agency as ChatGPT Downplays Risk
medianama.com · 2024
Traducido por IA

translated-es-A state-level Australian Information Commissioner has ordered Victoria state’s child protection agency to stop using generative AI services. According to the Information Commissioner, the agency staff entered a significant amo…

Variantes

Una "Variante" es un incidente que comparte los mismos factores causales, produce daños similares e involucra los mismos sistemas inteligentes que un incidente de IA conocido. En lugar de indexar las variantes como incidentes completamente separados, enumeramos las variaciones de los incidentes bajo el primer incidente similar enviado a la base de datos. A diferencia de otros tipos de envío a la base de datos de incidentes, no se requiere que las variantes tengan informes como evidencia externa a la base de datos de incidentes. Obtenga más información del trabajo de investigación.

Incidentes Similares

Por similitud de texto

Did our AI mess up? Flag the unrelated incidents

Australian Automated Debt Assessment System Issued False Notices to Thousands

Centrelink's debt recovery system lacks transparency and treated some customers unfairly, ombudsman finds

· 39 informes
Australian Retailers Reportedly Captured Face Prints of Their Customers without Consent

Facial recognition technology: Major retailers secretly creating “face prints” of their customers, says Choice

· 2 informes
Airbnb's Trustworthiness Algorithm Allegedly Banned Users without Explanation, and Discriminated against Sex Workers

Is Airbnb using an algorithm to ban users from the platform?

· 6 informes
Incidente AnteriorSiguiente Incidente