Dropping here our hackathon project from last weekend: https://twitter.com/lessand_ro/status/1648231096428134401TextbookGPT: answer questions with diagrams and grounded in textbook knowledge.
Thanks again for organizing and everyone in creating an awesome hackathon vibe!
👏 1
❤️ 3
m
Marko Klopets
04/18/2023, 5:31 PM
cool – how does it work? are the images labeled in any way, and/or accompanied by textbook text?
a
Alessandro Solbiati
04/18/2023, 10:12 PM
yes! we index images from open source textbooks embedding the surrounding text so ChatGPT can semantic search all the diagrams