I ve been digging into

Question

I ve been digging into <https github com deepset ai haystack> it feels more mature than langchain

Daniel Hsu · Answer

I ve also been pretty curious how it performs in comparison especially for the targeted use cases it has like semantic retrieval

Daniel Hsu · Answer

Have you built anything with it yet

Han · Answer

Neither one scales

Han · Answer

Haystack is for information retreieval Langchain is for chaining models together

Han · Answer

If you need to parse store a whole lot of data into a knowledge base search engine etc langchain is absolutely the wrong tool to use and is light years behind

Daniel Hsu · Answer

< Han> any recommendations for better tools for knowledge retrieval

Han · Answer

Both indexing and retrieval are in the realm of search engine information retrieval Depending on the need e g long term vs short term memory there are different tools suitable for the use cases

Han · Answer

Long term memory e g a lot of data you will be better off using existing data systems if it s already there Or use modern search engines like Elasticsearch Opensearch Weaviate Vespa etc Short term memory e g something that s short term in memory for sessions e g baybAGI autoGPT type of stuff duckDB ChromaDB basically duckdb + hnswlib Redis or just directly use an Numpy array

Han · Answer

There s also CozoDB that works in Python using either in memory or sqlite backend but it s not as popular outside of the embedded db people

Jim Park · Answer

< Daniel Hsu> I ve only just begun building To < Han> s point I think this project and the frameworks I m using all warrant performance rewrites at sufficient scale or pain I m open for critical feedback if you have any pray