E3S Web of Conferences (Jan 2024)

Exploring the roles of AI-Assisted ChatGPT in the field of data science

  • Valli Latha Narayanan,
  • Sujatha N.,
  • Mech Mukul,
  • V.S. Lokesh

DOI
https://doi.org/10.1051/e3sconf/202449101026
Journal volume & issue
Vol. 491
p. 01026

Abstract

Read online

In this study, we explore the roles of AI-assisted ChatGPT (Generative Pre-trained Transformer) in the field of data science. AI-assisted ChatGPT, a powerful language model, is fine-tuned using domain-specific data for specialised data science tasks, such as sentiment analysis and named entity recognition (NER). The results reveal significant reductions in model size and memory usage with minor trade-offs in inference time, providing valuable resource-efficient deployment. Various data augmentation methods, including back-translation, synonym replacement, and contextual word embeddings, are employed to augment the training dataset. The study's results are subjected to rigorous statistical analysis, including paired t-tests and ANOVA tests, to determine the significance of the findings. The research concludes with insightful suggestions and future scope, including advanced fine-tuning strategies, model optimization techniques, and ethical considerations.

Keywords