openvino_genai.T5EncoderModel#

class openvino_genai.T5EncoderModel#

Bases: pybind11_object

T5EncoderModel class.

__init__(*args, **kwargs)#

Overloaded function.

__init__(self: openvino_genai.py_openvino_genai.T5EncoderModel, root_dir: os.PathLike) -> None

T5EncoderModel class root_dir (os.PathLike): Model root directory.
__init__(self: openvino_genai.py_openvino_genai.T5EncoderModel, root_dir: os.PathLike, device: str, **kwargs) -> None

T5EncoderModel class root_dir (os.PathLike): Model root directory. device (str): Device on which inference will be done. kwargs: Device properties.
__init__(self: openvino_genai.py_openvino_genai.T5EncoderModel, model: openvino_genai.py_openvino_genai.T5EncoderModel) -> None

T5EncoderModel model: T5EncoderModel class model (T5EncoderModel): T5EncoderModel model

Methods

`__delattr__`(name, /)	Implement delattr(self, name).
`__dir__`()	Default dir() implementation.
`__eq__`(value, /)	Return self==value.
`__format__`(format_spec, /)	Default object formatter.
`__ge__`(value, /)	Return self>=value.
`__getattribute__`(name, /)	Return getattr(self, name).
`__gt__`(value, /)	Return self>value.
`__hash__`()	Return hash(self).
`__init__`(args, *kwargs)	Overloaded function.
`__init_subclass__`	This method is called when a class is subclassed.
`__le__`(value, /)	Return self<=value.
`__lt__`(value, /)	Return self<value.
`__ne__`(value, /)	Return self!=value.
`__new__`(**kwargs)
`__reduce__`()	Helper for pickle.
`__reduce_ex__`(protocol, /)	Helper for pickle.
`__repr__`()	Return repr(self).
`__setattr__`(name, value, /)	Implement setattr(self, name, value).
`__sizeof__`()	Size of object in memory, in bytes.
`__str__`()	Return str(self).
`__subclasshook__`	Abstract classes can override this to customize issubclass().
`compile`(self, device, **kwargs)	Compiles the model.
`get_output_tensor`(self, idx)
`infer`(self, pos_prompt, neg_prompt, ...)
`reshape`(self, batch_size, max_sequence_length)

__class__#: alias of pybind11_type

__delattr__(name, /)#: Implement delattr(self, name).

__dir__()#: Default dir() implementation.

__eq__(value, /)#: Return self==value.

__format__(format_spec, /)#: Default object formatter.

__ge__(value, /)#: Return self>=value.

__getattribute__(name, /)#: Return getattr(self, name).

__gt__(value, /)#: Return self>value.

__hash__()#: Return hash(self).

__init__(*args, **kwargs)#

Overloaded function.

__init__(self: openvino_genai.py_openvino_genai.T5EncoderModel, root_dir: os.PathLike) -> None

T5EncoderModel class root_dir (os.PathLike): Model root directory.
__init__(self: openvino_genai.py_openvino_genai.T5EncoderModel, root_dir: os.PathLike, device: str, **kwargs) -> None

T5EncoderModel class root_dir (os.PathLike): Model root directory. device (str): Device on which inference will be done. kwargs: Device properties.
__init__(self: openvino_genai.py_openvino_genai.T5EncoderModel, model: openvino_genai.py_openvino_genai.T5EncoderModel) -> None

T5EncoderModel model: T5EncoderModel class model (T5EncoderModel): T5EncoderModel model

__init_subclass__()#

This method is called when a class is subclassed.

The default implementation does nothing. It may be overridden to extend subclasses.

__le__(value, /)#: Return self<=value.

__lt__(value, /)#: Return self<value.

__ne__(value, /)#: Return self!=value.

__new__(**kwargs)#

__reduce__()#: Helper for pickle.

__reduce_ex__(protocol, /)#: Helper for pickle.

__repr__()#: Return repr(self).

__setattr__(name, value, /)#: Implement setattr(self, name, value).

__sizeof__()#: Size of object in memory, in bytes.

__str__()#: Return str(self).

__subclasshook__()#

Abstract classes can override this to customize issubclass().

This is invoked early on by abc.ABCMeta.__subclasscheck__(). It should return True, False or NotImplemented. If it returns NotImplemented, the normal algorithm is used. Otherwise, it overrides the normal algorithm (and the outcome is cached).

compile(self: openvino_genai.py_openvino_genai.T5EncoderModel, device: str, **kwargs) → None#: Compiles the model. device (str): Device to run the model on (e.g., CPU, GPU). kwargs: Device properties.

get_output_tensor(self: openvino_genai.py_openvino_genai.T5EncoderModel, idx: int) → openvino._pyopenvino.Tensor#

infer(self: openvino_genai.py_openvino_genai.T5EncoderModel, pos_prompt: str, neg_prompt: str, do_classifier_free_guidance: bool, max_sequence_length: int) → openvino._pyopenvino.Tensor#

reshape(self: openvino_genai.py_openvino_genai.T5EncoderModel, batch_size: int, max_sequence_length: int) → openvino_genai.py_openvino_genai.T5EncoderModel#