Has anyone worked with LlamaIndex (<https://gpt-in...
# 06-technical-discussionv
Vishwanath Seshagiri
03/29/2023, 8:34 PMHas anyone worked with LlamaIndex (https://gpt-index.readthedocs.io/en/latest/index.html#) but for non-text data? My use case is around building searchable indexes around observability data that is collected by the organizations. For eg, lot of companies use flame graphs, or distributed traces, which are inherently hierarchical in nature. It is also in some sense a sequence data and could be thought of as a sentence. I wanted to understand how I can modify LLamaIndex for some of the data we’ve collected on our cluster.
c
Conner Swann
03/29/2023, 9:43 PMMight be better to think of LLamaIndex as a text-only index, and to build an abstraction that lets an LLM agent query it as a “tool”.
Ex:
1. You have a “docs index” which the Agent uses to query for docs, and it is backed by a LLamaIndex SimpleVectorIndex
2. You have a “traces index” which the agent uses to query for relevant traces, and transforms the traces into text which can be passed back to the Agent as context for Q/A (assuming your goal is simple Q/A for this example)
Conner Swann
03/29/2023, 9:44 PMI am modeling my data-stores off the ChatGPT plugin abstraction, which I think frankly is very sage to do: https://github.com/openai/chatgpt-retrieval-plugin
Conner Swann
03/29/2023, 9:44 PMPresent a
/queryConner Swann
03/29/2023, 9:45 PMGot a lot of thoughts here, and just depends on what you’re trying to do, so feel free to ask more targeted questions to prompt my meat-LLM.
v
Vishwanath Seshagiri
03/29/2023, 9:46 PMOh wow! These are comprehensive, I’ll check it out and ask questions!!
Vishwanath Seshagiri
03/29/2023, 9:47 PMThanks a lot for the links! :)
🙌 1
c
Conner Swann
03/29/2023, 10:05 PMYou’re welcome, I am in deep haha
j
Jeffrey Sefa-Boakye
03/31/2023, 10:09 AMAwesome @Vishwanath Seshagiri @Conner Swann! I shared this question with Jerry Liu (we’re old colleagues) and he said better support for semi-structured data is on their immediate roadmap, but he’s happy to chat with either of you to brainstorm ideas. lemme know if you want to connect!
v
Vishwanath Seshagiri
03/31/2023, 12:52 PMHey! Jeffrey, thanks a lot for reaching out to him! I'd love to connect with him, if there is a chance! 🙂
c
Conner Swann
03/31/2023, 2:10 PMJerry is a great guy! You’d learn a lot from him @Vishwanath Seshagiri
➕ 2
v
Vishwanath Seshagiri
03/31/2023, 4:37 PMThat sounds amazing! Can't wait to meet with him! 🙂