Skip to main content

Incident · Junior

Samsung (May 2023): code leaks to ChatGPT

Real incident. Key points: DLP for LLMs, corporate gateway, and self-hosted vs SaaS.

9 min read · Incident on 2023-05, lasted · Source: Samsung · Content reviewed on October 23, 2026

Short answer

Real incident. Key points: DLP for LLMs, corporate gateway, and self-hosted vs SaaS. According to the Samsung memo, engineers accidentally leaked internal source code by uploading it to ChatGPT. The company started banning the use of generative AI tools like ChatGPT after discovering these uploads; the memo's goal was to prevent sensitive data from being sent to external servers.

01 · CONTEXT

Internal code typed into an external tool

According to the Samsung memo, engineers accidentally leaked internal source code by uploading it to ChatGPT. The company started banning the use of generative AI tools like ChatGPT after discovering these uploads; the memo's goal was to prevent sensitive data from being sent to external servers.

  1. According to the memo, engineers sent internal source code to the external tool on their own, with no inspection point on the path in the diagram.

    Architecture diagram: Direct upload of code to an external AI tool
    CLEmployee
    CPExternal AI tool
    DBProvider servers
  2. The concern described in the memo is that the typed text comes to reside on external servers, which makes it hard to retrieve and delete.

    Architecture diagram: Direct upload of code to an external AI tool
    CLEmployee
    CPExternal AI tool
    DBProvider serversHard to retrieve and delete
  3. The source leaves open whether the code was merely typed in or also inspected by someone outside; this diagram shows only the path of the upload and nothing beyond that.

    Architecture diagram: Direct upload of code to an external AI tool
    CLEmployee
    CPExternal AI tool
    DBProvider servers

The memo also warned people using these tools on personal devices not to upload company data, and said that violating this could lead to dismissal.

02 · WHAT THE SOURCE LEAVES OPEN

Documented risk, undisclosed details

The memo did not reveal what the code was and did not clarify whether it was merely typed into ChatGPT or also inspected by someone outside Samsung.

An internal company survey indicated that about 65% of the employees polled saw ChatGPT as a serious security threat.

03 · THE ARCHITECTURE PROBLEM

Where data leaves the company's control

The memo's concern was that everything typed into a tool like ChatGPT comes to reside on external servers, which makes it difficult to retrieve and delete that data and may make it accessible to other users. The text specifically cited the entry of sensitive code.

In design terms, the text leaves the company's environment the moment it is sent; so the natural control point is the boundary between the employee and the external service. DLP (data loss prevention) is the family of controls that inspects content at that boundary.

04 · SAMSUNG'S RESPONSE

Restrict first, build the secure environment later

The memo presented the restriction as temporary: headquarters was reviewing security measures to create a secure environment for using generative AI, and until they were ready, use was restricted.

MedidaWhat the report says
Temporary restrictionUse of generative AI was temporarily restricted until the measures were ready.
Internal toolsThe company was working on internal AI tools to translate, summarize, and develop software.
Upload blockingThe company was working on ways to block the sending of sensitive information to external services.

Samsung was not alone: other companies also restricted the technology, including Wall Street banks such as JPMorgan Chase, Bank of America, and CitiGroup.

05 · HOW TO DESIGN THE CONTROL

Corporate gateway, DLP, and the choice between SaaS and self-hosted

The following diagram is a conceptual proposal from the author of this study, not Samsung's architecture. It shows how a corporate gateway with a DLP filter can decide the destination of each AI request.

  1. Every AI request leaves the employee and enters through a single company gateway, instead of going straight to the external service.

    Architecture diagram: Corporate AI gateway with a DLP filter (conceptual proposal)
    CLEmployee
    NWCorporate AI gatewaynew
    CPFiltro DLP
    CPSelf-hosted model
    NWAudit log
    CPExternal AI service
  2. The gateway hands the content to the DLP filter, which inspects it before anything leaves the company network.

    Architecture diagram: Corporate AI gateway with a DLP filter (conceptual proposal)
    CLEmployee
    NWCorporate AI gateway
    CPFiltro DLPnew
    CPSelf-hosted model
    NWAudit log
    CPExternal AI service
  3. Content the filter clears can proceed to the external AI service.

    Architecture diagram: Corporate AI gateway with a DLP filter (conceptual proposal)
    CLEmployee
    NWCorporate AI gateway
    CPFiltro DLP
    CPSelf-hosted model
    NWAudit log
    CPExternal AI service
  4. Content flagged as sensitive is diverted to the self-hosted model and does not leave the company's infrastructure.

    Architecture diagram: Corporate AI gateway with a DLP filter (conceptual proposal)
    CLEmployee
    NWCorporate AI gateway
    CPFiltro DLP
    CPSelf-hosted modelnew
    NWAudit log
    CPExternal AI service
  5. The gateway logs usage and blocking events for auditing, without depending on people remembering the rule.

    Architecture diagram: Corporate AI gateway with a DLP filter (conceptual proposal)
    CLEmployee
    NWCorporate AI gateway
    CPFiltro DLP
    CPSelf-hosted model
    NWAudit lognew
    CPExternal AI service
CriterionExternal SaaSSelf-hosted model
Where the text livesOn the provider's serversOn the company's infrastructure
Operational effortTends to be lower for the companyTends to be higher, since the company operates the model
Control over retentionDepends on the provider's termsDefined by the company itself

Frequently asked questions

What is Samsung (May 2023): code leaks to ChatGPT?

Real incident. Key points: DLP for LLMs, corporate gateway, and self-hosted vs SaaS.

What does the Samsung (May 2023): code leaks to ChatGPT design cover?

It is organized in these sections: Internal code typed into an external tool, Documented risk, undisclosed details, Where data leaves the company's control, Restrict first, build the secure environment later, and Corporate gateway, DLP, and the choice between SaaS and self-hosted.

How long is Samsung (May 2023): code leaks to ChatGPT and what level is it?

It takes about 9 minutes to read and is rated Junior level.

Now design it yourself

Run this case as an interview in the System Design school: you make the decisions, the tutor challenges them and you see how your design scores.