Skip to main content

How do I build AI-enabled apps with OutSystems?

OutSystems

How do I create chat and voice-enabled apps?

Conversational Experiences give a  boost to applications by allowing interaction with users in their own language so that they are more engaged. These experiences are added to multichannel chat and voice interfaces and in-device voice assistant integration.

Chat Bots

  1. Azure bot framework

  2. Dialog Flow

The purpose of chat bots is to provide scalable support to customers in whatever channel they choose: Facebook Messenger, Slack, Telegram, text messages, and so on Since every business is different, chat bots must integrate with specific business processes and data. Although they all interface with a human, on the back-end, the source for data and information will be different. The challenge is to understand the intent behind the interaction and provide valuable information to the user.

Azure Bot Services and Microsoft Bot Framework

Why build your  bots from scratch, if you don’t have to? With Azure Bot Services and the Microsoft Bot Framework connectors, you can build, connect, deploy, and manage intelligent bots that interact naturally with your user. Azure Bot Service can be integrated with multiple channels to increase interaction and reach more customers. These channels include GroupMe, Facebook Messenger, Kik, Skype, Slack, Microsoft Teams, Telegram, text/SMS, Twilio, Cortana, and Skype for Business. You can also  integrate the bot in any web or mobile application.

To ensure the bot understands a person’s intent in the conversation so it can provide the correct answer,  Azure Bot Services uses a Language Understanding Service called LUIS. LUIS is cloud-based API service that applies custom machine-learning intelligence to a user's conversational, natural language text to predict overall meaning and pull out relevant, detailed information.

ai_page_graphics_13.png

In LUIS, you can configure the user’s utterances and the corresponding intent.

Through the OutSystems strategic partnership with Microsoft, supported components will be released in 2019 to easily connect to LUIS and for the Microsoft Bot Framework, allowing developers to use these capabilities in the OutSystems IDE and using the OutSystems Visual Language.

ai_page_graphics_23.png

Coming in 2019

Dialog Flow

With Dialog Flow, you can build engaging voice and text-based conversational interfaces, such as voice apps and chatbots. It can be integrated with multiple channels to increase interactions and reach more customers. Some of the available channels are Google Assistant, Amazon Alexa, Facebook Messenger, and other popular platforms and devices.

The Dialog Flow Natural Language Processor is already integrated, so it analyzes and understands the user's intent to deliver the most useful responses.

ai_page_graphics_15.png

There is a reviewed component for Dialog Flow that allows developers to use these capabilities in the OutSystems IDE and using the OutSystems Visual Language.

ai_page_graphics_16.png

The Forge component that should be used for Dialog Flow is the Dialog Flow Connector.

Virtual Private Assistants

  1. Siri

  2. Google Assistant

  3. Alexa

  4. Cortana

Virtual assistants typically do simple jobs, such as adding tasks to a calendar, doing a search on the web and sharing results, andr controlling and checking the status of smart home devices, including lights, cameras and thermostats. A big challenge that leads to major benefits is integrating existing  already implemented VPAs like Siri, Google Assistant or Alexa with our own applications.

Siri

Siri is the built-in, voice-controlled personal assistant available for Apple users. Siri is designed to offer seamless of interaction with iPhones, iPads, iPod Touch, or Apple Watch and has access to every other built-in application on an Apple device - Mail, Contacts, Messages, Maps, Safari and so on.

To develop mobile applications that interact with Siri, developers have two options: Siri Shortcuts and the SiriKit. With iOS 12 or higher,

Siri Shortcuts

Siri Shortcuts allow you to use Siri to call and open your application with a certain context.

Third-party apps need to support Siri Shortcuts before you can add them to Siri. If you don't see a shortcut for a third-party app, make sure that the app is up to date and check the App Store to see if the app supports Siri Shortcuts.

There is a reviewed component for Siri Shortcuts that allows developers to use these capabilities in the OutSystems IDE and using the OutSystems Visual Language.

ai_page_graphics_17.png

The Forge component that should be used for Siri Shortcuts is the Siri Shortcuts Plugin.

SiriKit

SiriKit encompasses the Intents and Intents UI Frameworks, which are used to implement app extensions that integrate services with Siri and Maps. SiriKit supports two types of app extensions:

  • An Intents app extension receives user requests from SiriKit and turns them into app-specific actions. For example, the user might ask Siri to send a message, book a ride, or start a workout using your app.

  • An Intents UI app extension displays branding or other customized content in the Siri or Maps interface after your Intents app extension fulfills a user request.

Components that use SiriKit will be created in to hide much of its complexity, allowing developers to use these capabilities in the OutSystems IDE and using the OutSystems Visual Language.

ai_page_graphics_18.png

Coming 2019

Google Assistant

A voice interaction is a special kind of Android activity that is triggered and completed by a user's voice. By contrast, normal activity intents are start an action and  complete it with a touch interaction.

There are two ways to integrate with Google Assistant: in-device integration or using Google Dialog Flow.

Screen Shot 2019-03-16 at 11.04.29 AM.png

Coming 2019

In-device integrations

For in-device integrations, components that use Voice Action will be created in 2019 that hide much of the complexity, allowing developers to use these capabilities in the OutSystems IDE and using the OutSystems Visual Language.

Google Dialog Flow

There is a reviewed component for Dialog Flow that allows developers to use these capabilities in the OutSystems IDE and using the OutSystems Visual Language.

ai_page_graphics_20.png

The Forge component that should be used for Dialog Flow is the Dialog Flow Connector.

Alexa

Alexa is Amazon’s cloud-based voice service available on devices from Amazon and third-party device manufacturers. With Alexa, it is possible to build natural voice experiences that offer customers more intuitive interactions with the technology they use every day.

Alexa converts spoken words to text using automatic speech recognition (ASR), deduces the speaker’s meaning using natural language understanding (NLU), and provides the underlying customer intent to your skill. The Natural Language Processor is already integrated, so it analyzes and understands the user's intent and can deliver the most useful response.

ai_page_graphics_21.png

There is a reviewed component for Alexa that allows developers to use these capabilities in the OutSystems IDE and using the OutSystems Visual Language.

ai_page_graphics_22.png

The Forge component that should be used for Alexa connection is Alexa.

Cortana

Cortana is Microsoft’s digital assistant. With the Cortana Skills Kit for Enterprise, businesses can now extend Cortana’s capability by building their own custom skills.

Cortana Skills Kit for Enterprise is built on top of Azure Bot Services; a skill is a speech bot. Use the Bot Framework connectors to build your speech bot, register it, and define your Cortana channel. The Bot Framework connectors provide features such as dialogs and built-in prompts so interacting with people is simpler.

Through the OutSystems strategic partnership with Microsoft, supported components will be released in 2019 to easily connect to Cortana Skills Kit and for Azure Bot Services, allowing developers to use these capabilities in the OutSystems IDE and using the OutSystems Visual Language.

ai_page_graphics_23.png

Coming 2019