Custom NLP Model can process only 10k characters for entity extraction

[vindhya3003]

Dear Google Cloud Support,

I'm encountering a character limit of 10k for entity extraction with Custom NLP, hindering my ability to process  in my project.Is it possible to increase this limit to accommodate text lengths of  more than 10k characters? I've explored alternatives like splitting text, but it's not feasible .for my usecase.Would appreciate if you could consider raising the limit or suggest alternative solutions.

[nimrah-waqar]

Increasing the character limit for entity extraction may not be feasible. Consider alternatives like batch processing, sampling, prioritization, text summarization, or exploring other NLP services with higher limits.

[nwm1085000]

Can you please share the dataset format for vertex ai model tune for entity extraction

i tried with below format but i am not confident about it

{
"contents": [
{
"parts": [
{
"text": "Hello, I'd like to know my current account balance and also the details of my recent transactions. I am also facing an issue with the transfer. Additionally, I want to request a new checkbook. Also check my investment account . I want to talk about loan. And also i need assistance on mortgage product."
}
],
"role": "user"
},
{
"parts": [
{
"text": "[{\"display_name\": \"Greeting\", \"start_offset\": 0, \"end_offset\": 5}, {\"display_name\": \"CustomerAction\", \"start_offset\": 7, \"end_offset\": 11}, {\"display_name\": \"AccountBalance\", \"start_offset\": 26, \"end_offset\": 41}, {\"display_name\": \"TransactionHistory\", \"start_offset\": 57, \"end_offset\": 75}, {\"display_name\": \"TransferIssue\", \"start_offset\": 112, \"end_offset\": 120}, {\"display_name\": \"ProductRequest\", \"start_offset\": 142, \"end_offset\": 155}, {\"display_name\": \"ProductType\", \"start_offset\": 156, \"end_offset\": 165}, {\"display_name\": \"ProductType\", \"start_offset\": 178, \"end_offset\": 195}, {\"display_name\": \"ProductType\", \"start_offset\": 204, \"end_offset\": 208}, {\"display_name\": \"ProductType\", \"start_offset\": 232, \"end_offset\": 240}, {\"display_name\": \"ProductType\", \"start_offset\": 245, \"end_offset\": 253}]"
}
],
"role": "model"
}
],
"systemInstruction": {
"parts": [
{
"text": "Response should be like this [\n {\n \"confidenceScore\": 0.65,\n \"offset\": 11,\n \"length\": 3,\n \"text\": \"exo\",\n \"category\": \"CustomerAction\"\n }]"
}
]
}
}