What is Chatgpt really? - Generative Pre-training Transformer (GPT) is a language model developed by OpenAI. It is a Transformer-based model that has been trained to predict the next word in a sequence of words. GPT uses an innovative technique called "masked language modeling" to learn the statistical structure of the language.