Package ai.djl.inference.streaming

package ai.djl.inference.streaming

Contains classes to implement streaming inference tasks.

See Also:

• Predictor

Related Packages

Package	Description
ai.djl.inference	Contains classes to implement inference tasks.

Class	Description
ChunkedBytesSupplier	A {link BytesSupplier} that supports chunked reading.
IteratorBytesSupplier	An IteratorBytesSupplier is a streaming BytesSupplier suitable for synchronous usage.
PublisherBytesSupplier	An PublisherBytesSupplier is a streaming BytesSupplier suitable for reactive asynchronous usage.
StreamingBlock	A Block possessing the additional streaming forward capabilities used by Predictor.streamingPredict(Object).
StreamingTranslator<I,O>	An expansion of the Translator with postProcessing for the StreamingBlock (used by Predictor.streamingPredict(Object).
StreamingTranslator.StreamOutput<O>	A StreamingTranslator.StreamOutput represents a streamable output type (either iterative or asynchronous).
StreamingTranslator.Support	What types of StreamingTranslator.StreamOutputs are supported by a StreamingTranslator.