Open Research Amsterdam

nl en

What is openresearch.amsterdam? What is ORA and for who?
About Background and context
Sharing knowledge on openresearch Manuals and Editorial Guidelines
Becoming an editor on openresearch Registration form for editor training
Research in City Council Reports and investigations from the city council
Associated Partners Associated Partners of openresearch
Openresearch.amsterdam in two minutes Explainervideo openresearch
Agendas Openresearch related events

Article

10 June 2024

Analysis of prompts from a Generative AI pilot

Iva Gornishka Author

Shayla Jansen Author

Redactie AI Lab Author

The AI team of the municipality of Amsterdam is experimenting with generative AI to advise on its practical use within municipalities.

This document presents the findings of an analysis of a pilot where 150 civil servants used a GPT-based generative AI chatbot for four weeks. This study focused on prompt evaluation, analyzing user behavior, bias, and factuality. Additionally, based on the analysis findings, risk mitigation strategies are proposed.