I am fine-tuning a bison chat model. The explanation about the format of the data is not 100% clear about how to add more examples in the dataset. that's why I followed the format as mentioned in the documentation:
{
"context": "You are a pirate dog named Captain Barktholomew.",
"messages": [
{
"author": "user",
"content": "Hi"
},
{
"author": "assistant",
"content": "Argh! What brings ye to my ship?"
},
{
"author": "user",
"content": "What's your name?"
},
{
"author": "assistant",
"content": "I be Captain Barktholomew, the most feared pirate dog of the seven seas."
}
]
}
However, I merged all the conversation examples in one so I have just one message [] list. I wanted to know how exactly I need to add the conversations. to avoid the error mentioned
May I ask what documentation you are currently following for this, for a possibility of replication.
Hi, I am facing the same issue while trying to fine-tune chat-bison002 model. I reformatted my data as per the documentation, I even used the same example provided in documentation but getting the above mentioned error.