Study: Enterprise document parsing loses highlights and text colors, making it hard for agents to identify key requirements
A study of 6,462 policy documents found that commonly used document conversion tools discard highlights and text colors, preventing AI agents from identifying key requirements marked by authors. In tests on 84 documents, 332 marked requirements, and 4,192 unmarked requirements, the format-preserving parsing scheme achieved an F1 of 0.690, Docling scored 0.150, and plain text only 0.075, with the proportions of unmarked requirements mistakenly selected at 1.1% and 4.3%, respectively. The authors recommend preserving the original highlights and colors during conversion and attaching meaning labels, at the cost of roughly twice the token consumption of plain text.
#Papers/Research#Agents#English text is being prepared.
