Has anyone taken the plunge on fine tuning any of the LLaMA

Question

Has anyone taken the plunge on fine tuning any of the LLaMA 2 models Working my way through that using the <https huggingface co docs autotrain llm finetuning|Huggingface autotrainer > and have many questions

Clay Smith · Answer

should have searched first <https cerebral valley slack com archives C04SZTQU84R p1691088344656879|https cerebral valley slack com archives C04SZTQU84R p1691088344656879>

Clay Smith · Answer

< umar ıgan> All the examples I m seeing are for QA fine tuning is it possible to fine tune with general knowledge or is the idea you embed facts in answers etc

Ankush Agarwal · Answer

I m starting to go down this rabbit hole I want to train it on a general set of documents will share my findings as i go

umar ıgan · Answer

Not necessarily < Clay Smith> the reason of fine tuning on QA dataset is to make a domain specific LLM here is an example of more generalist approach