Inferring the correlation between X and Y, or writing an article in a magazine. Between these two tasks, which one can only be done by a human, and which can be done by a machine? It would seem like the answer is fairly straightforward isn’t it? Inferring a correlation between two variables is math. Of course a human could do it. But that would be tedious and time consuming. It would be easier to just let the machine do that, because it can. But writing an article? That is an art. It takes creativity and imagination to write, surely only a human would be capable of doing something like that? Oh how far technology has come.
In May 2020 researchers unveiled the latest advancement in Natural Language Processing (NLP). Dubbing it Generative Pre-trained Transformer 3 (GPT-3). In technical terms GPT-3 is “an autoregressive language model with 175 billion parameters”. In kinder terms, it is a machine learning model that has been pre-trained using a large dataset to “learn” how to write like a human (autoregressive language model). And It has a lot of parameters that can be finely tuned by a user to speak in a very specific way (175 billion parameters). So once given a prompt, like a question, GPT-3 is able to return a response that would sound like it is coming from a human. It has become so proficient at this that authors, and multiple reviewers, have asserted that it is almost indistinguishable from a human response.
It is worth noting though that GPT-3 is able to accomplish this feat because it has analyzed the frequency of how certain words appear next to each other. As an example, GPT-3 may “know” that the word “grapes” is frequently used with words like eat, sweet, fruit, purple, and/or wine. But it doesn’t actually fully comprehend the fact that a grape is a sweet purple fruit that we can either eat or turn into wine.
But despite these faults GPT-3 is making great inroads. And a whole crop of different applications that use it as a foundation are cropping up. I was recently made aware of one such new application called Headlime. A company that is using GPT-3 to help companies produce articles for publication.
So I thought we could have a bit of fun with this new application. The way that Headlime works is that the user is meant to give the GPT-3 model a few keywords and a prompt to get started. And then using that as…
