Experiences Developing a Computer Vision SDK for Mobile Apps

Harty, Julian (2024). Experiences Developing a Computer Vision SDK for Mobile Apps. In: IEEE/ACM 11th International Conference on Mobile Software Engineering and Systems (MOBILESoft '24), 14-15 Apr 2024, Lisbon, Portugal, ACM.

DOI: https://doi.org/10.1145/3647632.3651393

Abstract

We developed a mobile SDK that ran several ML models on device that was used by app developers who integrated the SDK into their app to provide real-time guidance and decisions based on what the on-device camera and other inputs provided. The SDK was instrumented with mobile analytics. We encountered various challenges on the journey and at least some of these might be of research interest.

Plain Language Summary

This short paper presents the experiences of a small team of software developers who created some software that uses the camera of a mobile phone to collect pictures of a distinct activity. These pictures are processed by the software that has been trained with similar pictures of that activity - the training is known as machine learning. Our software is used by other software. Our software is called an SDK, shorthand for a Software Development Kit. The other software are known as apps.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI