AI-102 Designing and Implementing an Azure AI Solution is a 4-Day class intended for software developers wanting to build AI infused applications that leverage Azure Cognitive Services, Azure Cognitive Search, and Microsoft Bot Framework. The course will use C# or Python as the programming language.
WHO SHOULD ATTEND
Software engineers concerned with building, managing and deploying AI solutions that leverage Azure Cognitive Services, Azure Cognitive Search, and Microsoft Bot Framework. They are familiar with C# or Python and have knowledge on using REST-based APIs to build computer vision, language analysis, knowledge mining, intelligent search, and conversational AI solutions on Azure.
PREREQUISITES
Before attending this course, students must have:
- Knowledge of Microsoft Azure and ability to navigate the Azure portal
- Knowledge of either C# or Python
- Familiarity with JSON and REST programming semantics
GOALS
Students will learn to,
- Prepare to develop AI solutions on Azure
- Create and consume Cognitive Services
- Secure Cognitive Services
- Monitor Cognitive Services
- Deploy cognitive services in containers
- Extract insights from text with the Language service
- Translate text with the Translator service
- Create speech-enabled apps with the Speech service
- Translate speech with the speech service
- Build a Language Understanding model
- Publish and use a Language Understanding app
- Build a question answering solution
- Create a bot with the Bot Framework SDK
- Create a Bot with the Bot Framework Composer
- Analyze images
- Analyze video
- Classify images
- Detect objects in images
- Detect, analyze, and recognize faces
- Read Text in Images and Documents with the Computer Vision Service
- Extract data from forms with Form Recognizer
- Create an Azure Cognitive Search solution
- Create a custom skill for Azure Cognitive Search
- Create a knowledge store with Azure Cognitive Search
OUTLINE
Module 1 :Prepare to develop AI solutions on Azure
- Define artificial intelligence
- Understand AI-related terms
- Understand considerations for AI Engineers
- Understand considerations for responsible AI
- Understand capabilities of Azure Machine Learning
- Understand capabilities of Azure Cognitive Services
- Understand capabilities of the Azure Bot Service
- Understand capabilities of Azure Cognitive Search
Module 2 :Create and consume Cognitive Services
- Provision Cognitive Services resources in an Azure subscription.
- Identify endpoints, keys, and locations required to consume a Cognitive Services resource.
- Use a REST API to consume a cognitive service.
- Use an SDK to consume a cognitive service.
Module 3 :Secure Cognitive Services
- Consider authentication for Cognitive Services
- Manage network security for Cognitive Services
Module 4 :Monitor Cognitive Services
- Monitor Cognitive Services costs
- Create alerts
- View metrics
- Manage diagnostic logging
Module 5 : Deploy cognitive services in containers
- Create Containers for Reuse
- Deploy to a Container
- Secure a Container
- Consume Cognitive Services from a Container
Module 6 : Extract insights from text with the Language service
- Detect language
- Extract key phrases
- Analyze sentiment
- Extract entities
- Extract linked entities
Module 7 : Translate text with the Translator service
- Provision a Translator resource
- Understand language detection, translation, and transliteration
- Specify translation options
- Define custom translations
Module 8 : Create speech-enabled apps with the Speech service
- Provision an Azure resource for the Speech service
- Use the Speech-to-Text API to implement speech recognition
- Use the Text-to-Speech API to implement speech synthesis
- Configure audio format and voices
- Use Speech Synthesis Markup Language (SSML)
Module 9 : Translate speech with the speech service
- Provision Azure resources for speech translation.
- Generate text translation from speech.
- Synthesize spoken translations.
Module 10 : Build a Language Understanding model
- Provision Azure resources for Language Understanding
- Define intents, utterances, and entities
- Use patterns to differentiate similar utterances
- Use pre-built entity components
- Train, test, publish, and review a Language Understanding model
Module 11 : Publish and use a Language Understanding app
- Understand capabilities of a Language Understanding app
- Process predictions from a Language Understanding app
- Deploy a language understanding app in a container
Module 12 : Build a question answering solution
- Understand question answering
- Compare question answering to language understanding
- Create a knowledge base
- Implement multi-turn conversation
- Test and publish a knowledge base
- Consume a knowledge base
- Implement active learning
- Create a question answering bot
Module 13 : Create a bot with the Bot Framework SDK
- Understand principles of bot design
- Use the Bot Framework SDK to build a bot
- Deploy a bot to Azure
Module 14 : Create a Bot with the Bot Framework Composer
- Understand dialogs
- Plan conversational flow
- Design the user experience
- Create a bot with the Bot Framework Composer
Module 15 : Analyze images
- Provision a Computer Vision resource
- Analyze an image
- Generate a smart-cropped thumbnail
Module 16 : Analyze video
- Describe Video Analyzer for Media capabilities
- Extract custom insights
- Use Video Analyzer for Media widgets and APIs
Module 17 : Classify images
- Provision Azure resources for Custom Vision
- Understand image classification
- Train an image classifier
Module 18 : Detect objects in images
- Provision Azure resources for Custom Vision
- Understand object detection
- Train an object detector
- Consider options for labeling images
Module 19 : Detect, analyze, and recognize faces
- Identify options for face detection, analysis, and identification
- Understand considerations for face analysis
- Detect faces with the Computer Vision service
- Understand capabilities of the Face service
- Compare and match detected faces
- Implement facial recognition
Module 20 : Read Text in Images and Documents with the Computer Vision Service
- Read text from images with the Read API
- Use the Computer Vision service with SDKs and the REST API
- Develop an application that can read printed and handwritten text
Module 21 : Extract data from forms with Form Recognizer
- Identify how Form Recognizer’s layout service, prebuilt models, and custom service can automate processes
- Use Form Recognizer’s Optical Character Recognition (OCR) capabilities with SDKs, REST API, and Form Recognizer Studio
- Develop and test custom models
Module 22 : Create an Azure Cognitive Search solution
- Create an Azure Cognitive Search solution
- Develop a search application
Module 23 : Create a custom skill for Azure Cognitive Search
- Implement a custom skill for Azure Cognitive Search
- Integrate a custom skill into an Azure Cognitive Search skillset
Module 24 : Create a knowledge store with Azure Cognitive Search
- Create a knowledge store from an Azure Cognitive Search pipeline
- View data in projections in a knowledge store
LABS
- Lab : Get Started with Cognitive Services
- Lab : Manage Cognitive Services Security
- Lab : Monitor Cognitive Services
- Lab : Use a Cognitive Services Container
- Lab : Analyze Text
- Lab : Translate Text
- Lab : Recognize and Synthesize Speech
- Lab : Translate Speech
- Lab : Create a Language Understanding App
- Lab : Create a Language Understanding Client Application
- Lab : Use the Speech and Language Understanding Services
- Lab : Create a QnA Solution
- Lab : Create a Bot with the Bot Framework SDK
- Lab : Create a Bot with Bot Framework Composer
- Lab : Analyze Images with Computer Vision
- Lab : Analyze Video
- Lab : Classify Images with Custom Vision
- Lab : Detect Objects in Images with Custom Vision
- Lab : Detect, Analyze, and Recognize Faces
- Lab : Read Text in Images
- Lab : Extract Data from Forms
- Lab : Create an Azure Cognitive Search solution
- Lab : Create a Custom Skill for Azure Cognitive Search
- Lab : Create a Knowledge Store with Azure Cognitive Search