Uploaded on Jul 29, 2020
PPT on All about Open AI's GPT-3.
All about Open AI's GPT-3.
All about Open AI's GPT-3
Introduction
• The AI is the largest language model ever developed, and can produce incredible human-like text
on demand but does not get us closer to true intelligence.
• GPT-3 playing feels like looking into the future.
Source: Venture Beat
What is GPT-3?
• OpenAI's third-generation Generative Pretrained Transformer, GPT-3, is a general-purpose
language algorithm that uses machine learning to translate text, answer questions, and write
text predictively.
• It analyzes a series of terms, text and other data, then elaborates on those examples in order to
generate fully original production in the form of an article or an image.
Source: Towards Data Science
How GPT-3 works!!!
• GPT-3 has 175 billion learning parameters that allow it to perform almost any task assigned to
it, making it larger than the second most effective language model, Microsoft Corp.'s Turing-
NLG algorithm, which has 17 billion parameters for learning.
Source: OpenAI
Predecessor GPT-2
• OpenAI reported its observations and tests in February 2019 on their unsupervised language
model, GPT-2, which was trained in 40Gb texts and was able to predict words in close proximity.
• GPT-2, a language based on transformers applied to self-attention, allowed researchers to
produce very persuasive and coherent texts.
• The program, which is a common-purpose language algorithm, used machine learning to
translate text, answer questions and write text predicatively
Source: Jay Alammar
Why Is GPT-3 Such A Big Deal?
• As people are still wondering why GPT-3 is so hyped, the response is simple- it is the largest
model that has been educated. The 175 learning parameters outweigh any previous non-sparse
language model by 10 times.
• GPT-3 is used for all tasks without the need for gradient changes or fine tuning. It just takes a
few-shot demonstrations of the model through textual interaction.
Source: Medium
Applications
• Rightly answer trivia questions
• Predict the final word of sentences by knowing the paragraph's meaning
• For a story pick the best ending out of many
• Translate modern languages, which GPT-2 initially found difficult
• Using reasoning which involves common sense
• Perform with precision 5 optical arithmetics
• Write news articles with human nature from a title
Source: Pixabay
Users’ View
• Founders Fund Principal Delian Asparouhov shared an excellent example of GPT-3 in which he
fed half of an investment memo that he had posted on his company website to the algorithm.
He then gave half of an essay to GPT-3 on how to conduct successful board meetings.
• GPT-3 produced coherent and new paragraphs of text in both cases that followed the earlier
formatting in such a way that it was almost indistinguishable from the original text.
Source: Pixabay
Break Through
• The GPT-3 of Open AI has been a big leap in achieving it by hitting the highest level of human-
like intelligence through ML and NLP, in their quest to ensure that artificial general intelligence
(AGI) outperforms humans at most economically beneficial work-benefits for all humanity.
Source: Pixabay
Tests/ Experiments
• This is confirmed by tests carried out by early participants, who are left amazed by the results.
• We can only wonder what their next-gen technologies will accomplish.
Source: Pixabay
Conclusion
• The new version of their GPT-3 natural language processing platform is only available in private
beta, and OpenAI only offers access to its API on invitation.
• A long waiting list exists for the paid version, which is scheduled to be released in the next two
months.
Source: Pixabay
Comments