# All your data are belong to us

Recently we have seen OpenAI, a company excessivly funded by Microsoft, trialing a Large Language Model (LLM) called chatGPT.

It is one of the first Neural Networks (NN) one can basically chat with and have somewhat of a dialogue. The remarkable thing about chatGPT is that it has an usually very convincing opinion about any topic. To train such a LLM one needs enormous amounts of data. It is somewhat kept in the dark with what data chatGPT was and is trained with. However, there are some leaks by internal sources which make sense considering the accuracy chatGPT is able to talk about any topic. One of the data sets is called books2, it is basically most of all pirated books there ever are. [0]

That is an interesting fact from a legal perspective.

The sketchy thing with LLMs or NNs in general is that storage and compute somewhat smear into each other and it is basically impossible to tell where what is stored or where what is computed. One could say that the data and the compute are compressed and encrypted in the NN. chatGPT being a Transformer type of architecture [1] its compression part becomes even more obvious.

Why would Microsoft trial such a legally dangerous thing in a somewhat unrelated company called OpenAI for a while? It is entirely in the realm of possibility to assume that they wanted to see if the world would react in any legal way to this fact. The world did not. And now chatGPT basically flows into any product of Microsoft.

How can it be that there are companies who run their entire data on Microsoft premises? From communication, to document storage, and operating systems. With GitHub being owned by Microsoft and their AI coding assistant GitHub Copilot having a fathomable track-record [2] of being trained and regurgirating copyrighted code, even their code?

Who in their right mind would do this?

Sources:

• [0] amont others, these are interesting
• [0] [1] https://www.searchenginejournal.com/how-to-block-chatgpt-from-using-your-website-content
• [0] [2] https://www.reddit.com/r/ChatGPT/comments/10xfksf/can_anyone_confirm_this_list_100_of_sources_used/
• [0] [3] https://www.reddit.com/r/ChatGPT/comments/10xfksf/comment/j7uk8x4/?utm_source=reddit&utm_medium=web2x&context=3
• [1] https://rscircus.github.io/2020/02/22/transformer.html
• [2] https://www.google.com/search?hl=en&q=copilot%20copyrighted%20code
• In case you wonder about the article’s title: https://en.wikipedia.org/wiki/All_your_base_are_belong_to_us