See Edge MLOps in Action Request a Demo

Products

The Latent AI Efficient Inference Platform (LEIP) gives everybody from developers to IT the same tool to use to move neural networks from development to device simply, reliably, and securely with a dedicated and principled edge MLOps workflow.

Technology
Features

LEIP is an MLOps Software Development Kit (SDK) that can optimize and secure neural network runtimes for specific hardware targets. LEIP creates ultra-efficient and portable models optimized for compute, energy, and memory without requiring any changes to existing AI/ML infrastructure and frameworks. Customizable templates called Recipes are pre-qualified for a wide range of hardware targets and enable rapid prototyping of new models.

click the image to see hi-resolution

Ultra-Efficient AI Inference for Edge Devices

LEIP compresses conventional AI models below 8-bit integer precision but without losing result accuracy, creating up to a 10x reduction in size and a 3x improvement in inference. And with Latent AI’s Adaptive AI technology, the model can self-regulate its computational needs, only firing the parts of the neural network necessary to get the job done.

Secure Model Optimization Pipeline Automation

With LEIP, ML engineers develop optimized neural network runtimes for heterogeneous low power hardware (CPU/GPU/DSP). Our Latent-AI-Runtime-Engine (LRE) offers a modular micro-service software stack for secured inference processing, with support for CI/CD and asset tracking across the entire model life-cycle.

Fast Deployment with Development Consistency

Latent AI takes the hard work out of design and deployment by exploring thousands of candidate recipes that are pre-configured for your hardware. With hundreds of possible target models and hardware already in place, LEIP Recipes makes it easy to find the best optimized configuration that meets your design requirements.

Benefits

Scaling

LEIP builds the repeatability, reproducibility, and rapidity into edge model creation necessary for scaling the number of edge devices that can be supported.

And by making development consistent across models and hardware targets, projects that used to take weeks can now be completed in just hours.

Trust

LEIP builds trust for managing machine learning across models and datasets by enabling a repeatable process through automation, testing, and validation.

ML developers can use the same test/validation software at all stages of development, which greatly enhances the reliability and credibility of the AI model.

Seamless Integration

LEIP provides standardized and well-defined APIs to support integration into CI/CD software development flows.

This approach allows data science and software deployment teams to collaborate far more easily and leverage their individual strengths by defining handoff points between the two.

Better Use of Data

Because of shortened production cycles, LEIP enables enterprise stakeholders to capitalize on new data quickly and drive new iterations of the AI model.

This rapid development pace helps drive reliable AI analytics and actionable insights.

Scaling

LEIP builds the repeatability, reproducibility, and rapidity into edge model creation necessary for scaling the number of edge devices that can be supported.

And by making development consistent across models and hardware targets, projects that used to take weeks can now be completed in just hours.

Trust

LEIP builds trust for managing machine learning across models and datasets by enabling a repeatable process through automation, testing, and validation.

ML developers can use the same test/validation software at all stages of development, which greatly enhances the reliability and credibility of the AI model.

Seamless Integration

LEIP provides standardized and well-defined APIs to support integration into CI/CD software development flows.

This approach allows data science and software deployment teams to collaborate far more easily and leverage their individual strengths by defining handoff points between the two.

Better Use of Data

Because of shortened production cycles, LEIP enables enterprise stakeholders to capitalize on new data quickly and drive new iterations of the AI model.

This rapid development pace helps drive reliable AI analytics and actionable insights.

MLOps for the Edge

Learn how LEIP scales reliable delivery to the edge with repeatable and secure processes that produce models optimized for memory, power, and compute.

Watch Video