Package ai.djl.modality.nlp.generate

package ai.djl.modality.nlp.generate

Contains utility classes for image manipulation.

Related Packages

Package	Description
ai.djl.modality.nlp	Contains utility classes for natural language processing tasks.
ai.djl.modality.nlp.bert	Contains classes that deal with BERT for natural language pre-processing tasks.
ai.djl.modality.nlp.embedding	Contains classes that deal with word embeddings for natural language pre-processing tasks.
ai.djl.modality.nlp.preprocess	Contains utility classes for natural language pre-processing tasks.
ai.djl.modality.nlp.qa	Contains utility classes for question and answer processing.
ai.djl.modality.nlp.translator	Contains utility classes for each of the predefined translator.

Classes

Class	Description
BatchTensorList	BatchTensorList represents a search state, and the NDArrays inside are updated in each iteration of the autoregressive loop.
CausalLMOutput	CausalLMOuput is used to contain multiple output of a language model.
ContrastiveSeqBatchScheduler	ContrastiveSeqBatchScheduler is a class which implements the contrastive search algorithm used in SeqBatchScheduler.
SearchConfig	SearchConfig is a class whose fields are parameters used for autoregressive search / text generation.
SeqBatcher	SeqBatcher stores the search state (BatchTensorList), the control variables (e.g.
SeqBatchScheduler	This is a scheduler, serving as an API to the consumer of the system, allowing for three major actions: initForward, addBatch, fastForward, collectResults.
StepGeneration	StepGeneration is a utility class containing the step generation utility functions used in autoregressive search.
TextGenerator	TextGenerator is an LMSearch (language model search) which contains multiple autoregressive search methods.