Skip to content

Navigation Menu

Sign in
Sign up

Latest commit

History

5 Commits

Folders and files

NameName
Last commit message
Last commit date

Repository files navigation

Unstructured Data Conversion

Introduction

This is a small app that uses the EvaDB ChatGPT utility to convert unstructured data to a provided stuctured format. For the timebeing we focus on user hardware and software complaints. The data/user_complaints.csv file contains some example queries.

We run them through ChatGPT via a crafted prompt which classifies the Issue category and Issue Component along with displaying the raw issue string. The default format is the following

DEFAULT_STRUCTURE_FORMAT = [
 [
 "Issue Category",
 "What category the issue belongs to",
 "One of (hardware, software)",
 ],
 [
 "Raw Issue String",
 "Raw String containing the exact input given by the user",
 "string",
 ],
 ["Issue Component", "Component that is causing the issue", "string"],
]

Results

Query : The keyboard on my laptop is typing the wrong letters and it's driving me crazy!
✅ Answer:
{
 "Issue Category": "hardware",
 "Raw Issue String": "The keyboard on my laptop is typing the wrong letters and it's driving me crazy!",
 "Issue Component": "keyboard"
}
✅ Answer:
Query : My headphones won't connect to my phone anymore, even though they used to work just fine.
{
 "Issue Category": "hardware",
 "Raw Issue String": "My headphones won't connect to my phone anymore, even though they used to work just fine.",
 "Issue Component": "headphones"
}

Setup and running the application

Clone the project

git clone https://github.com/hershd23/eva-structure-gpt.git
cd eva-structure-gpt

Create a new python environment in conda or venv, and activate that environement (Optional but recommended)

python3 -m venv /env
source env/bin/activate

Install the dependencies

pip install -r requirements.txt

Simply run the main.py file and input the query, openai key and any additional inputs you want to add to the prompt

python3 main.py

Future Work

  • Currently the prompt and and the structure are kind of static. Allow user to add their own structure and paradigm of data.
  • More experimentation required with the prompt

About

Structure unstructured data using the ChatGPT utility in EvaDB

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages

AltStyle によって変換されたページ (->オリジナル) /