According to Gartner, a market research firm, ‘As the smartphone market shifts from selling technology products to delivering compelling and personalised experiences, artificial intelligence (AI) based solutions running on the smartphone will become an essential part of vendor roadmaps over the next two years’.
Gartner predicts that by 2022, 80 per cent of smartphones shipped will have on-device AI capabilities compared to 10 per cent in 2017. On-device AI is currently limited to premium devices and provides better data protection and power management than full cloud-based AI, since data is processed and stored locally.
The AI-based features will also help smartphone vendors to acquire new customers while retaining current users. Going forward, smartphones will combine two or more AI capabilities and technologies to provide more advanced user experiences.
Gartner has identified 10 high-impact uses for AI-powered smartphones to enable vendors to provide more value to their customers.
Smartphones will be able predict your next move
Gartner believes that future smartphones will be an extension of the user, capable of recognising them and predicting their next move. They will understand who you are, what you want, when you want it, how you want it done and execute tasks upon your authority.
‘Your smartphone will track you throughout the day to learn, plan and solve problems for you. It will leverage its sensors, cameras and data to accomplish these tasks automatically. For example, in the connected home, it could order a vacuum bot to clean when the house is empty, or turn a rice cooker on 20 minutes before you arrive’, said Angie Wang, Principle Research Analyst at Gartner.
User authentication
Password-based, simple authentication is becoming too complex and less effective, resulting in weak security, poor user experience and a high cost of ownership. Security technology combined with machine learning, biometrics and user behaviour will improve usability and self-service capabilities.
For example, smartphones can capture and learn a user's behaviour, such as patterns when they walk, swipe, apply pressure to the phone, scroll and type, without the need for passwords or active authentications.
Emotion recognition
Emotion sensing systems and affective computing allow smartphones to detect, analyse, process and respond to people's emotional states and moods. The proliferation of virtual personal assistants and other AI-based technology for conversational systems is driving the need to add emotional intelligence for better context and an enhanced service experience. Car manufacturers, for example, can use a smartphone's front camera to understand a driver's physical condition or gauge fatigue levels to increase safety.
Natural-Language Understanding
Continuous training and deep learning on smartphones will improve the accuracy of speech recognition, while better understanding the user's specific intentions. For instance, when a user says ‘the weather is cold’, depending on the context, his or her real intention could be ‘please order a jacket online’ or ‘please turn up the heat’. As an example, natural-language understanding could be used as a near real-time voice translator on smartphones when traveling abroad.
Augmented Reality (AR) and AI vision
With the release of iOS 11, Apple included an ARKit feature that provides new tools to developers to make adding AR to apps easier. Similarly, Google announced its ARCore AR developer tool for Android and plans to enable AR on nearly 100 million Android devices by the end of next year.
Google expects almost every new Android phone will be AR-ready out of the box next year. One example of the use of AR is apps that help collect user data and detect illnesses such as skin cancer or pancreatic cancer.
Device management
Machine learning will also improve device performance and standby time. For example, with many sensors, smartphones can better understand and learn user's behaviour, such as when to use which app. The AI-based smartphones will be able to keep frequently used apps running in the background for quick re-launch or to shut down unused apps to save memory and battery.
Personal profiling
With the increased penetration of technology in our lives, smartphones are now able to collect data for behavioural and personal profiling. Users can receive protection and assistance dynamically, depending on the activity that is being carried out and the environments they are in (e.g., home, vehicle, office or leisure activities). Further, with AI-based capabilities service providers such as insurance companies can now focus on users rather than the assets. For example, they will be able to adjust the car insurance rate based on driving behaviour.
Content censorship/detection
With advanced recognition software available in market, computers can now detect any content that violates any laws or policies. With AI in place, restricted content can be automatically detected, objectionable images, videos or text can be flagged and various notification alarms can be enabled.
For instance, taking photos in high security facilities or storing highly classified data on company-paid smartphones will automatically notify IT.
Personal photographing
Cameras in smartphones have evolved tremendously, producing DSLR like images, and by further integrating camera tech with AI, smartphones in future will automatically produce beautified photos based on the user's individual aesthetic preferences.
For example, people from the East and the West have different aesthetic preferences – most Chinese people prefer a pale complexion, whereas consumers in the West tend to prefer tan skin tones, something that can be automatically done in near future.
Audio analytic
AI capability on a smartphone’s microphone can instruct users or trigger events. For example, if a smartphone hears a user snoring, it can trigger the user's wristband to encourage a change in sleeping positions.
‘With smartphones increasingly becoming a commodity device, vendors are looking for ways to differentiate their products. Future AI capabilities will allow smartphones to learn, plan and solve problems for users. This isn't just about making the smartphone smarter, but augmenting people by reducing their cognitive load. However, AI capabilities on smartphones are still in very early stages’, said CK Lu, Research Director at Gartner.
