GPU Image Transforms
Resize, normalize, crop, flip, rotate, and blur — each available as a standalone call or chained in a pipeline. All operations run on the accelerator.
Vision
Images and video.
Straight to the model.
A complete image and video runtime for machine learning. Load, decode, transform, and normalise through one GPU-first media runtime. Every frame arrives as a tensor, ready for inference or training.
What it covers
From raw media to model-ready tensors.
Image Processing
Comprehensive image transformations for machine learning. Resize, normalize, crop, and more — all optimized for GPU workloads.
Video Decode
Vulkan Video decoding for H.264, H.265, AV1, and VP9 when the device exposes the required profiles and formats.
Ml Bridge
Seamless integration with machine learning pipelines. Video frames become model-ready tensors in a single operation.
Capability-Gated
One vendor-neutral API admits only the codec, format, queue, and kernel routes exposed by the selected device.
OA Viewer
The runtime has a visible surface.
OA Viewer makes image and video state inspectable while the same device-resident values continue to serve a pipeline. These captures come from the C++ Viewer; matching Rust and Python Viewer previews now exist in the private development tree.
Capabilities
Everything between your media and your model.
Semantic images and video frames remain device-resident through ingest, transformation, model preparation, and preview. Stateful decode sessions exist only where media lifecycle requires them.
API
Clean surface. No ceremony.
Each operation is a direct call. No pipeline objects to configure before you can resize an image. No session lifecycle for a normalisation pass. Stateful resources — decoders, encoders — exist where they earn their keep.
A short path from file to matrix.
This condensed SDK path decodes a JPEG, resizes it on the device, applies brightness and contrast, and reads the semantic image as a matrix. Rust and Python keep the same operation sequence.
1use oa::{Engine, ImageFormat, Path, image};23let engine = Engine::new()?;4let path = Path::asset_rel("image/visionTestPattern320x180.jpg");5let source = image::decode_file(&engine, &path, ImageFormat::Rgb)?;6let small = image::resize(&source, 160, 90,7 image::InterpolationMode::Bilinear)?;8let adjusted = image::brightness_contrast(&small, 0.05, 1.1)?;9let values = adjusted.as_matrix().read_f32()?;10assert_eq!(values.len(), 3 * 90 * 160);
Media Support
Standard formats. Hardware decode where available.
Vision queries the selected device before opening a session, then admits only the codec, format, queue, conversion, and resolution routes it can support. Hardware-specific decisions stay private while availability remains explicit.
H.264 / AVC
Vulkan Video hardware decode when the selected device exposes the required profile, queue, and formats.
H.265 / HEVC
Capability-gated hardware decode with explicit admission rather than an unconditional platform claim.
AV1
Hardware decode where the device and driver expose the complete codec contract required by the stream.
VP9
A queried hardware path where available, with unsupported devices remaining explicit.
Zero-copy decode path
Decoded frames stay device-resident as they transition from video output to shader-readable work.
Hardware colour conversion
YCbCr-to-RGB uses sampler conversion where admitted and a measured compute route where required.
Ml and preview
One decoded frame can feed a normalized model input and an RGBA preview without a second decode.
Capability admission
Codec, resolution, format, queue, and conversion support are queried before a stateful session opens.
Oa Library
One library. Across the stack.
Follow the same Engine, values, and explicit execution contract into another module.