openvino_genai.SpeechGenerationConfig#

class openvino_genai.SpeechGenerationConfig#

Bases: GenerationConfig

Speech-generation specific parameters: :param minlenratio: minimum ratio of output length to input text length; prevents output that’s too short. :type minlenratio: float

Parameters:

maxlenratio – maximum ratio of output length to input text length; prevents excessively long outputs.
threshold (float) – probability threshold for stopping decoding; when output probability exceeds above this, generation will stop.

__init__(*args, **kwargs)#

Overloaded function.

__init__(self: openvino_genai.py_openvino_genai.SpeechGenerationConfig, json_path: os.PathLike | str | bytes) -> None

path where generation_config.json is stored

__init__(self: openvino_genai.py_openvino_genai.SpeechGenerationConfig, **kwargs) -> None

Methods

`__delattr__`(name, /)	Implement delattr(self, name).
`__dir__`()	Default dir() implementation.
`__eq__`(value, /)	Return self==value.
`__format__`(format_spec, /)	Default object formatter.
`__ge__`(value, /)	Return self>=value.
`__getattribute__`(name, /)	Return getattr(self, name).
`__getstate__`()	Helper for pickle.
`__gt__`(value, /)	Return self>value.
`__hash__`()	Return hash(self).
`__init__`(args, *kwargs)	Overloaded function.
`__init_subclass__`	This method is called when a class is subclassed.
`__le__`(value, /)	Return self<=value.
`__lt__`(value, /)	Return self<value.
`__ne__`(value, /)	Return self!=value.
`__new__`(**kwargs)
`__reduce__`()	Helper for pickle.
`__reduce_ex__`(protocol, /)	Helper for pickle.
`__repr__`()	Return repr(self).
`__setattr__`(name, value, /)	Implement setattr(self, name, value).
`__sizeof__`()	Size of object in memory, in bytes.
`__str__`()	Return str(self).
`__subclasshook__`	Abstract classes can override this to customize issubclass().
`_pybind11_conduit_v1_`
`is_assisting_generation`(self)
`is_beam_search`(self)
`is_greedy_decoding`(self)
`is_multinomial`(self)
`is_prompt_lookup`(self)
`set_eos_token_id`(self, tokenizer_eos_token_id)
`update_generation_config`(self, **kwargs)
`validate`(self)

Attributes

`__annotations__`
`adapters`
`apply_chat_template`
`assistant_confidence_threshold`
`diversity_penalty`
`do_sample`
`echo`
`eos_token_id`
`frequency_penalty`
`ignore_eos`
`include_stop_str_in_output`
`length_penalty`
`logprobs`
`max_length`
`max_new_tokens`
`max_ngram_size`
`maxlenratio`
`min_new_tokens`
`minlenratio`
`no_repeat_ngram_size`
`num_assistant_tokens`
`num_beam_groups`
`num_beams`
`num_return_sequences`
`presence_penalty`
`repetition_penalty`
`rng_seed`
`stop_criteria`
`stop_strings`
`stop_token_ids`
`structured_output_config`
`temperature`
`threshold`
`top_k`
`top_p`

__annotations__ = {}#

__class__#: alias of pybind11_type

__delattr__(name, /)#: Implement delattr(self, name).

__dir__()#: Default dir() implementation.

__eq__(value, /)#: Return self==value.

__format__(format_spec, /)#

Default object formatter.

Return str(self) if format_spec is empty. Raise TypeError otherwise.

__ge__(value, /)#: Return self>=value.

__getattribute__(name, /)#: Return getattr(self, name).

__getstate__()#: Helper for pickle.

__gt__(value, /)#: Return self>value.

__hash__()#: Return hash(self).

__init__(*args, **kwargs)#

Overloaded function.

__init__(self: openvino_genai.py_openvino_genai.SpeechGenerationConfig, json_path: os.PathLike | str | bytes) -> None

path where generation_config.json is stored

__init__(self: openvino_genai.py_openvino_genai.SpeechGenerationConfig, **kwargs) -> None

__init_subclass__()#

This method is called when a class is subclassed.

The default implementation does nothing. It may be overridden to extend subclasses.

__le__(value, /)#: Return self<=value.

__lt__(value, /)#: Return self<value.

__ne__(value, /)#: Return self!=value.

__new__(**kwargs)#

__reduce__()#: Helper for pickle.

__reduce_ex__(protocol, /)#: Helper for pickle.

__repr__()#: Return repr(self).

__setattr__(name, value, /)#: Implement setattr(self, name, value).

__sizeof__()#: Size of object in memory, in bytes.

__str__()#: Return str(self).

__subclasshook__()#

Abstract classes can override this to customize issubclass().

This is invoked early on by abc.ABCMeta.__subclasscheck__(). It should return True, False or NotImplemented. If it returns NotImplemented, the normal algorithm is used. Otherwise, it overrides the normal algorithm (and the outcome is cached).

_pybind11_conduit_v1_()#

property adapters#

property apply_chat_template#

property assistant_confidence_threshold#

property diversity_penalty#

property do_sample#

property echo#

property eos_token_id#

property frequency_penalty#

property ignore_eos#

property include_stop_str_in_output#

is_assisting_generation(self: openvino_genai.py_openvino_genai.GenerationConfig) → bool#

is_beam_search(self: openvino_genai.py_openvino_genai.GenerationConfig) → bool#

is_greedy_decoding(self: openvino_genai.py_openvino_genai.GenerationConfig) → bool#

is_multinomial(self: openvino_genai.py_openvino_genai.GenerationConfig) → bool#

is_prompt_lookup(self: openvino_genai.py_openvino_genai.GenerationConfig) → bool#

property length_penalty#

property logprobs#

property max_length#

property max_new_tokens#

property max_ngram_size#

property maxlenratio#

property min_new_tokens#

property minlenratio#

property no_repeat_ngram_size#

property num_assistant_tokens#

property num_beam_groups#

property num_beams#

property num_return_sequences#

property presence_penalty#

property repetition_penalty#

property rng_seed#

set_eos_token_id(self: openvino_genai.py_openvino_genai.GenerationConfig, tokenizer_eos_token_id: SupportsInt) → None#

property stop_criteria#

property stop_strings#

property stop_token_ids#

property structured_output_config#

property temperature#

property threshold#

property top_k#

property top_p#

update_generation_config(self: openvino_genai.py_openvino_genai.SpeechGenerationConfig, **kwargs) → None#

validate(self: openvino_genai.py_openvino_genai.GenerationConfig) → None#