Dropping here our hackathon project from last weekend: https://twitter.com/lessand_ro/status/1648231096428134401 TextbookGPT: answer questions with diagrams and grounded in textbook knowledge. Thanks again for organizing and everyone in creating an awesome hackathon vibe!

cool – how does it work? are the images labeled in any way, and/or accompanied by textbook text?

yes! we index images from open source textbooks embedding the surrounding text so ChatGPT can semantic search all the diagrams