ChatGPT: the state of the art
In November 2022, OpenAI announced the web preview of its conversational AI system, ChatGPT, available to the general public. This was the start of huge hype coming from subject matter experts, organizations, and the general public – to the point that, after only 5 days, the service reached 1 million users!
Before writing about ChatGPT, I will let it introduce itself:
Figure 2.25 – ChatGPT introduces itself
ChatGPT is built on top of an advanced language model that utilizes a modified version of GPT-3, which has been fine-tuned specifically for dialogue. The optimization process involved Reinforcement Learning with Human Feedback (RLHF), a technique that leverages human input to train the model to exhibit desirable conversational behaviors.
We can define RLHF as a machine learning approach where an algorithm learns to perform a task by receiving feedback from a human. The algorithm is trained to make decisions...
