User Guide

Evaluate your attribute in Adobe Acrobat Analyzer

Confirm that extracted values in a document are correct and provide feedback to improve attribute accuracy.

Use this process to evaluate how an attribute extracts values across multiple documents in a collection. Reviewing real results helps you identify inconsistencies, unexpected matches, and gaps in extraction before you apply the attribute more broadly.

Note

You are responsible for creating, testing, and validating custom attributes to ensure they meet your organization’s requirements. Adobe Acrobat Analyzer provides tools for evaluation and feedback; however, accuracy depends on your input and subsequent refinement.

Before you begin

  • You must have permission to view and edit attributes.
  • The attribute you want to evaluate must already exist.
  • You need access to documents that are expected to contain the attribute.
  • Evaluation supports selecting up to 10 documents at a time.

Evaluate your attribute

  1. Open the Attributes tab.

  2. Select the attribute you want to evaluate.

    The attribute definition opens automatically.

  3. Select Evaluate attribute under the attribute definition.

    The attribute page with the definition exposed and the "Evaluate attribute" button highlighted.

  4. Select up to 10 documents to evaluate.

    • The All files collection is selected by default.
      • Use the collections dropdown to filter the list to a single collection.
      • Use the Search by File Name field to narrow the list of documents.
  5. Select Evaluate files.

    The page refreshes to display the evaluation results.

    The "Evaluate attribute" list with filters applied.

Review extracted results

After the evaluation completes, a table displays each selected document with the extracted value shown next to the file name.

This view shows how the attribute behaves across documents:

  • Review the extracted value for each document.
  • Review the Detailed attribute description at the bottom of the page for context.
  • Hover over a document row and select Review to inspect a specific result.
The "Evaluate attribute" page with the "Review" button highlighted.

When reviewing an individual extracted value:

  • The page highlights where the value was extracted.
  • A copy of the extracted content appears alongside the document.
The document citation with the in-document location highlighted and the text of the extraction beside it.

Use Back to return to the results table and review additional documents.

Reviewing multiple documents helps reveal whether extraction behavior is consistent or requires adjustment.

Refine the attribute

After reviewing the extracted values, you may find that the attribute needs refinement.

Initial results are often too broad or too narrow. Refining the attribute definition and re-running the extraction helps improve accuracy over time.

If extracted values are incorrect or inconsistent:

  • Select Show Explanation to display an additional column that explains why specific content was selected.
  • Use this explanation to understand how the attribute description is being interpreted.

Update the Detailed attribute description directly from the evaluation page and save your changes.

After saving, Re-analyze documents becomes available. Select it to see how the updated description affects extraction results.

The attribute evaluation page with the "Re-analyze the document" button highlighted.

Use Advanced options when needed

If refinement alone does not produce acceptable results, use Advanced options in the attribute definition.

Advanced options let you provide examples that guide extraction behavior:

  • Add positive examples to show what the attribute should match.
  • Add negative examples to show what should be excluded.
  • Use 1–5 examples to avoid over-tuning.

These examples help reduce ambiguity and improve consistency across documents.

The attribute definition highlighting the Advanced options

When to refine an attribute

Refine your attribute if you notice:

  • Missing values that should have been found.
  • Values that are too broad, such as full sentences instead of specific terms.
  • Incorrect values that resemble the target concept.
  • Inconsistent results across similar documents.

Small adjustments to your description, type, or examples often resolve these issues.

When to recreate an attribute

If repeated refinement does not produce consistent results, it may be more effective to recreate the attribute with:

  • A simpler description.
  • A narrower scope.
  • Fresh examples.
  • A more specific attribute type (text, date, or number).

Recreating an attribute can help remove earlier assumptions or overfitting introduced during refinement.

When your attribute is ready

An attribute is ready for broader use when:

  • Extractions consistently return the correct value across evaluated documents.
  • Documents that do not contain the attribute correctly return no value.
  • Formatting and answer structure follow your defined expectations.
  • Results remain stable after minor refinements.

Once validated on a small set of documents, expand the evaluation to larger datasets to identify remaining patterns or edge cases.

You can also refresh attributes within curated collections to observe behavior at scale.

Adobe, Inc.

Get help faster and easier

New user?