Choose an inference operation
Choose an operation based on what your application needs to do with the source content.
Question answering
Use Q&A to submit natural-language questions about collection or document content.
The API provides both streaming and non-streaming Q&A.
Streaming Q&A returns the response incrementally as it's generated. Use it when your interface should display generated content progressively.
Streaming Q&A also supports controlling whether Custom Instructions are applied to the request. You can also control whether reasoning is generated for a streaming Q&A response.
Non-streaming Q&A waits for the generation to complete and returns the finished response. Use it when your application does not need to display partial output.
Summarization
Use summarization to generate a condensed representation of document content.
The API reference defines the current request requirements and supported inputs.
Context search
Use context search to retrieve content relevant to the specified search text.
This can help applications identify relevant source material without generating a conversational response.
Property extraction
Use extraction when your application needs structured values from document content.
An extraction definition can identify information such as:
Property name: contract_value
Type: integer
Description: Agreement contract value
Prompt: Extract the largest agreement value in dollars.
The returned result can include the extracted value, confidence information, and source attribution.