Uploaded on Feb 26, 2024
A comparison of a literature review by ChatGPT and expert writers
A comparison of a literature review by ChatGPT and expert writers
DIFFERENT TYPES OF
METHODOLOGIES IN
MANAGEMENT PHD
RESEARCH
An Academic presentation by
Dr. Nancy Agnes, Head, Technical Operations, Tutors India
Group www.tutorsindia.com
Email: [email protected]
ChatGPT- an innovative content
generation tool
• ChatGPT (Generative Pre-trained Transformer), developed by
OpenAI, is an artificial intelligence language tool that used
machine learning algorithms to develop text (Ariyaratne,
2023). Those who adopted ChatGPT early have praised the
tool for the content it develops.
• ChatGPT produces content that is coherent and difficult to
distinguish from the text written by humans.
• However, there are numerous articles that highlight the end of
traditional assignments, as ChatGPT could generate high-
scoring papers and stimulate critical thinking.
• The ethical and permissible limits of ChatGPT's use in
scientific writing are still unknown (Gao, 2022).
Studies on the reliability of ChatGPT content
Research has been conducted on determining the capabilities of chatbots with scientific rigour.
• According to Yeadon et al. (2023), ten essays on physics were assessed for academic content,
comprehension of the underlying topic and writing style. The results revealed that the essays written by AI
were of a high-quality, but the quality varies in a way similar to essays written by humans.
• A study by Herbold et al. (2023) that compared the essays written by Humans and ChatGPT, it was
discovered that using ChatGPT resulted in high-quality essays and was effective in writing argumentative
essays.
• The content generated by AI was highly structured and had identical beginnings of the concluding sections,
such as “Overall”, “In summary ”and “In conclusion”. On the other hand, human-written essays are looser in
structure and representing the guidelines.
• However, researchers have noted the limitation of CharGPT for research purposes: ChatGPT does not
produce original ideas; it generates content based on the training data.
• This phenomenon significantly increases the chances of plagiarism.
• A study conducted by Ariyaratne et al. in 2023 revealed that four out of five papers generated by ChatGPT
were erroneous, and one had false references.
• This raises the question of authenticity of using ChatGPT for academic research. Kleebayon (2023) noted
that ChatGPT has a tendency for giving a biased content.
• Moreover, scholars ague that when CharGPT cannot co-author a research, it is unethical to use ChatGPT for
literature review and other academic research (Haman, 2023).
ChatGPT vs Expert Writers :
• Liao and Sundar (2023) conducted an experiment that describes about the MAIN model for
communication. The following is an excerpt from the study, serving as a proof that ChatGPT cannot be
used for conducting a literature review:
Prompt: Describe MAIN Model by Shyam Sundar
ChatGPT: The MAIN Model, developed by S. Shyam Sundar, is a theoretical
framework that explains how people process and make sense of information
they encounter online, and how the design of digital media platforms
shapes this process. The acronym MAIN stands for Media Affordances and
Heuristics-based Information Processing. The model posits that the design of
digital media platforms, specifically the technological affordances of the
platform, shapes the cognitive heuristics that users employ when processing
information.
• For the uninitiated, the answer seems correct. However, those who have specialised in the field can
discern its accuracy.
• Likewise, if a student refers exclusively to ChatGPT without referring to academic publications for their
literature review, they may get the concepts wrong and their literature review may be adversely affected.
• Here is the content for the MAIN model, written by a human:
• MAIN model, conceptualised by Shyam Sundar, is an acronym for the four key purposes of media that can
have psychological effects on the audience- Modality (M), Agency (A), Interactivity (I) and Navigability
(N).
• Although the source and content of digital media are crucial in establishing ascribed credibility, the MAIN
model focuses on the technological characteristics of digital media that can influence credibility
judgements.
CONCLUSION
• ChatGPT is a type of Artificial Intelligence tool based on Large Language Models that have been trained
to generate human-like content.
• It has gained significant interest from many users for its content. Research has shown that ChatGPT
can produce structured essays.
• However, there were some concerns regarding the sources, plagiarism and the quality of content.
• From the comparison between ChatGPT-generated content and human content, it is evident that the
content from ChatGPT is incorrect.
• Therefore, students must exercise caution before blindly using ChatGPT for assistance with their
assignments and dissertations. Nevertheless, they can use ChatGPT for help with structuring their
content.
ABOUT TUTORS INDIA
• At Tutors India, we are a team of academic researchers and writers who assist students with writing a
literature review.
• Our team is diverse, enabling us to guide students specialising in various disciplines.
• We ensure selecting articles from reputed journals and abide by the university guidelines for
assignments, essays and dissertations.
• Moreover, we proofread and edit the content, ensuring the review is error- and plagiarism-free.
Contact Us
UK +44 -
1143520021
INDIA +91 -
8754446690
EMAIL [email protected]
Comments