Popular image generation models can be prompted to produce identifiable photos of real people, potentially threatening their privacy. The work also shows that these AI systems can be made to regurgitate exact copies of medical images and copyrighted work by artists.

Here is the research paper (pdf): https://arxiv.org/pdf/2301.13188.pdf