Exporting GEN AI Models#
Prepare models using OVMS pull mode (recommended).
Prepare models using python script.
Prepare models using OVMS with python optimum pull mode.
Note: For several large generative models on limited memory, use Idle servable management (preview). Configure
--cache_dirto reduce model wake-up latency.