Go to the Attributes tab and select the attribute you want to test.
- Overview of Adobe Acrobat Analyzer
- System Requirements
- Product Constraints
- Transaction consumption for Adobe Acrobat Analyzer
- Release Notes
- Technical notes and release schedule
- Admin and configuration
- Documents and Collections
- Attributes
- Integrations
- SharePoint setup
- Support
Evaluate your attribute to confirm it’s extracting the right information before you scale up.
Test and evaluate your attribute within the built-in Evaluation Workflow
Testing a custom attribute helps you confirm that Adobe Acrobat Analyzer is extracting the right information before you apply it across larger document sets. Evaluate your attribute early and refine it based on real results to improve accuracy over time.
Note
You are responsible for creating, testing, and validating custom attributes to ensure they meet your organization’s requirements. Acrobat Analyzer provides tools for evaluation and feedback; however, accuracy depends on your input and subsequent refinement.
Evaluate a custom attribute
-
-
Choose Evaluate attribute.
-
Select up to 10 documents for testing.
Pick documents you know contain the information you’re targeting.
-
Select Evaluate to extract and display results.
-
The page reloads to display the list of document names on the left, and the extracted value for that document to the right.
To get a deeper understanding as to why the attribute extracted the value it did, select the Show explanation button.
Acrobat Analyzer displays a table with the document name, the extracted value, and an explanation for why the value was selected on this document.
-
Hover your pointer over a record and select the Review button:
-
Mark each result as Yes (Correct) or No (Incorrect).
Add a brief note when marking incorrect results to help improve accuracy.
Evaluate each returned value and verify that the correct value was extracted or not. This process helps tune the attribute to your expectation.
-
If the attribute isn't returning the proper values
- Carefully evaluate the explanations for the returned values
- Refine the attribute’s description or examples as needed
- Test again.
Feedback you provide during the evaluation workflow—marking values as correct or incorrect—helps Acrobat Analyzer better understand what you expect the attribute to return.
Troubleshoot "Not Found" attribute results using the suggestions on the Tips and Tricks page.
When to refine an attribute
Refine your attribute if you notice:
- Missing values that should have been found
- Values that are too broad (e.g., entire sentences instead of specific terms)
- Incorrect values that resemble the target concept
- Inconsistent results across similar documents
Small adjustments to your description, type, or examples often resolve these issues.
When to recreate an attribute
If you refine the description, add examples, adjust the type, and test repeatedly but still see inconsistent results, it may be faster to recreate the attribute with:
- A simpler description
- Narrower scope
- Fresh examples
- Be more specific in the attribute type: text, date, or number. (Text is the broadest.)
Re-creating the attribute often helps remove earlier assumptions or overfitting.
When your attribute is ready
Your attribute is ready for broader use when:
- Extractions correctly find the data you are looking for and also correctly identify which documents do not have the attribute you are looking for across all 10 documents.
- Formatting or answer structure follows your specific instructions.
- Results remain stable after minor refinements.
Once the attribute is accurate for a small dataset, expand its usage to a bigger dataset to observe any patterns or areas of improvement. You have the option of "Refreshing all attributes" within the curated collections of documents.
