omnipkg
A distributed runtime hypervisor for Python enabling concurrent, zero-copy multi-framework orchestration.
A distributed runtime hypervisor for Python enabling concurrent, zero-copy multi-framework orchestration.
To install this package, run one of the following:
OmniPkg 2.0.0 represents a paradigm shift from package management to a Distributed Runtime Architecture. It functions as a local Hypervisor for Python, allowing conflicting AI frameworks and hardware drivers to run concurrently in the same workflow with near-zero latency.
This release introduces three critical architectural advancements for ML/AI pipelines:
Universal GPU Inter-Process Communication (IPC): Implements a custom, framework-agnostic CUDA IPC protocol using raw ctypes. This enables true zero-copy tensor handoffs between isolated processes (e.g., passing data from PyTorch to TensorFlow) with ~1.5ms latency, significantly outperforming standard serialization methods.
Selective Hardware Virtualization: Features dynamic LDLIBRARYPATH injection at the worker level. This allows different worker processes to utilize different CUDA Toolkit versions or runtime libraries (e.g., running legacy models on CUDA 11 alongside modern models on CUDA 12) simultaneously on the same host machine without conflict.
Elastic Persistent Daemon Architecture: Replaces ad-hoc process spawning with a self-healing, elastic worker pool. Workers utilize a "clean slate" architecture, morphing into specific framework environments on-demand and purging themselves after execution. This reduces environment context switching latency from ~2000ms (cold start) to ~60ms (warm).
OmniPkg 2.0 eliminates the need for complex container orchestration for local multi-model inference, providing a unified, high-performance runtime for complex scientific and financial modeling workflows.
Summary
A distributed runtime hypervisor for Python enabling concurrent, zero-copy multi-framework orchestration.
Information Last Updated
Dec 8, 2025 at 22:59
License
AGPL-3.0-only
Total Downloads
3.2K
Platforms
GitHub Repository
https://github.com/1minds3tDocumentation
https://github.com/1minds3t/omnipkg/tree/main/docs