Ampere Computing Logo
Ampere Computing Logo
CASE STUDY

Lightly Lowers Costs and Improves Performance Using GCP T2A Instances Powered by Ampere Processors

09 February 2024

INTRODUCTION

Lightley.ai's innovative data curation tool faced substantial roadblocks due to the inherent limitations of its GPU-based deployments. Key challenges included poor scalability, where full GPU allocation proved inefficient during periods of low demand, significant processing overhead between CPU pre-processing and GPU inference tasks, and a complex, costly procurement process for compute resources across both on-premises and cloud environments. These issues not only hindered efficient resource utilization but also burdened developer time, highlighting an urgent need for a more agile and cost-effective solution. This case study explores how Lightley.ai strategically partnered with Ampere, migrating their data curation tool to GCP T2A instances powered by Ampere Altra processors, to overcome these obstacles and fundamentally transform their AI deployments and operational efficiency.

COMPANY DESCRIPTION

Lightly.ai develops a cutting-edge cloud-based and on-premises data curation tool that significantly enhances the quality of video and image datasets for machine learning model training. They provide a comprehensive AI data preparation feedback loop, encompassing active learning, data exploration, online selection, and model monitoring. Computer Vision Suite Lightly.ai empowers companies to train machine learning models efficiently with optimal datasets, enabling production-ready and enterprise-grade AI solutions that process large volumes of data effectively.

Challenges

Lightley.ai 's GPU-based deployments faced significant hurdles: poor scalability with full GPU allocation during low demand, substantial overhead between CPU pre-processing and GPU inference, and costly, complex procurement for both on-premises and cloud. These issues hindered efficient resource utilization and burdened developer time, necessitating a more agile and cost-effective solution for their data curation tool.

Solution

To resolve GPU limitations, Lightly.ai partnered with Ampere to migrate their data curation tool to GCP T2A instances powered by Ampere Cloud Native processors. This innovative move enabled flexible, single-unit processing, seamlessly integrating fast video decoding with rapid model inference. This solution effectively addressed their scalability, overhead, and procurement challenges, streamlining AI deployments and operations.

Benefits

Lightly.ai achieved remarkable benefits, including over 3x cost reduction and decreased run-time on Ampere-based GCP T2A instances. They experienced 7.8x better performance compared to GPU alternatives. The high core count of Ampere® Altra® processors offers superior scaling flexibility, making them easily provisionable and readily available, transforming their AI inference capabilities and operational efficiency.

Performance Benchmarking

info-graph-chart1.png


“When running machine learning models on video data the GPUs can’t unleash their full potential as they are bottlenecked by the decoding speed. One would need to get more custom and expensive instances where the balance between decoding and processing is properly tuned.”


— Igor Susmelj, Co-founder,
Lightly.ai

table.png

Ampere® Altra family of cloud-native processors provides sizeable advantages over the tested GPU instance. Lightly.ai’s customers can achieve 7.8x better performance


“Lightly.ai’s customers can achieve over 3x cost reduction running on Ampere T2A instances on GCP using Ampere AI software solutions for AI Inference, in addition to optimized performance. The next generation AmpereOne C3A instances on GCP will deliver on this continued value proposition.”


— Igor Susmelj, Co-founder,
Lightly.ai

Resource Library

Find additional stories and product information from Ampere experts, developers and customers.


© 2025 Ampere® Computing LLC. All rights reserved. Ampere®, Ampere® Computing, Altra and the Ampere® logo are all trademarks of Ampere® Computing LLC or its affiliates. Other product names used in this publication are for identification purposes only and may be trademarks of their respective companies.

Created At : November 21st 2025, 8:03:17 pm
Last Updated At : February 10th 2026, 6:33:16 pm
Ampere Logo

Ampere Computing LLC

4655 Great America Parkway Suite 601

Santa Clara, CA 95054

image
image
image
image
image
 |  |  | 
© 2025 Ampere Computing LLC. All rights reserved. Ampere, Altra and the A and Ampere logos are registered trademarks or trademarks of Ampere Computing.
This site runs on Ampere Processors.