CMD + K

omnipkg

Community

A distributed runtime hypervisor for Python enabling concurrent, zero-copy multi-framework orchestration.

Installation

To install this package, run one of the following:

Conda
$conda install conda-forge::omnipkg

Usage Tracking

2.0.0
1.6.2
1.6.1
1.6.0
1.5.14
5 / 8 versions selected
Total downloads: 0

Description

OmniPkg 2.0.0 represents a paradigm shift from package management to a Distributed Runtime Architecture. It functions as a local Hypervisor for Python, allowing conflicting AI frameworks and hardware drivers to run concurrently in the same workflow with near-zero latency.

This release introduces three critical architectural advancements for ML/AI pipelines:

  1. Universal GPU Inter-Process Communication (IPC): Implements a custom, framework-agnostic CUDA IPC protocol using raw ctypes. This enables true zero-copy tensor handoffs between isolated processes (e.g., passing data from PyTorch to TensorFlow) with ~1.5ms latency, significantly outperforming standard serialization methods.

  2. Selective Hardware Virtualization: Features dynamic LDLIBRARYPATH injection at the worker level. This allows different worker processes to utilize different CUDA Toolkit versions or runtime libraries (e.g., running legacy models on CUDA 11 alongside modern models on CUDA 12) simultaneously on the same host machine without conflict.

  3. Elastic Persistent Daemon Architecture: Replaces ad-hoc process spawning with a self-healing, elastic worker pool. Workers utilize a "clean slate" architecture, morphing into specific framework environments on-demand and purging themselves after execution. This reduces environment context switching latency from ~2000ms (cold start) to ~60ms (warm).

OmniPkg 2.0 eliminates the need for complex container orchestration for local multi-model inference, providing a unified, high-performance runtime for complex scientific and financial modeling workflows.

About

Summary

A distributed runtime hypervisor for Python enabling concurrent, zero-copy multi-framework orchestration.

Information Last Updated

Dec 8, 2025 at 22:59

License

AGPL-3.0-only

Total Downloads

3.2K

Platforms

noarch Version: 2.0.0