https://cerebralvalley.ai logo
#06-technical-discussion
Title
# 06-technical-discussion
v

Vishwanath Seshagiri

03/29/2023, 8:34 PM
Has anyone worked with LlamaIndex (https://gpt-index.readthedocs.io/en/latest/index.html#) but for non-text data? My use case is around building searchable indexes around observability data that is collected by the organizations. For eg, lot of companies use flame graphs, or distributed traces, which are inherently hierarchical in nature. It is also in some sense a sequence data and could be thought of as a sentence. I wanted to understand how I can modify LLamaIndex for some of the data we’ve collected on our cluster.
c

Conner Swann

03/29/2023, 9:43 PM
Might be better to think of LLamaIndex as a text-only index, and to build an abstraction that lets an LLM agent query it as a “tool”. Ex: 1. You have a “docs index” which the Agent uses to query for docs, and it is backed by a LLamaIndex SimpleVectorIndex 2. You have a “traces index” which the agent uses to query for relevant traces, and transforms the traces into text which can be passed back to the Agent as context for Q/A (assuming your goal is simple Q/A for this example)
I am modeling my data-stores off the ChatGPT plugin abstraction, which I think frankly is very sage to do: https://github.com/openai/chatgpt-retrieval-plugin
Present a
/query
and implement that based on whatever you need to do for the underlying data store to provide context
Got a lot of thoughts here, and just depends on what you’re trying to do, so feel free to ask more targeted questions to prompt my meat-LLM.
v

Vishwanath Seshagiri

03/29/2023, 9:46 PM
Oh wow! These are comprehensive, I’ll check it out and ask questions!!
Thanks a lot for the links! :)
🙌 1
c

Conner Swann

03/29/2023, 10:05 PM
You’re welcome, I am in deep haha
j

Jeffrey Sefa-Boakye

03/31/2023, 10:09 AM
Awesome @Vishwanath Seshagiri @Conner Swann! I shared this question with Jerry Liu (we’re old colleagues) and he said better support for semi-structured data is on their immediate roadmap, but he’s happy to chat with either of you to brainstorm ideas. lemme know if you want to connect!
v

Vishwanath Seshagiri

03/31/2023, 12:52 PM
Hey! Jeffrey, thanks a lot for reaching out to him! I'd love to connect with him, if there is a chance! 🙂
c

Conner Swann

03/31/2023, 2:10 PM
Jerry is a great guy! You’d learn a lot from him @Vishwanath Seshagiri
2
v

Vishwanath Seshagiri

03/31/2023, 4:37 PM
That sounds amazing! Can't wait to meet with him! 🙂