One thing that I realized when I used Langchain is that it makes a huge difference when you're chaining requests and the first one returns an undesirable output. The mental model of thinking that the API will return the right answer is not true anymore!
04/14/2023, 1:19 AM
Yeah, you have to become comfortable with probabilistic pipelines in some senses.
Using self-refine, or self-checking is a way to mitigate some errors at the cost of additional calls.
Yes, I've seen this library! It is just a very different way of thinking, as opposed to before when you could assume that the API will return the right response and there are error states which are definitely errors.