Unlock video insights
Extract rich insights from video and audio files using a rich set of machine learning algorithms.
2019 NAB Show Product of the Year Award winner
2018 IABM Peter Wayne Golden BaM Award® for Design and Innovation winner
2018 BaM AWARD® winner in the Manage category
About Azure AI Video Indexer
Azure AI Video Indexer builds upon media AI technologies to make it easier to extract insights from videos. Power new forms of content discovery such as searching for spoken words, faces and emotions. Enrich your apps with embedded video insights to drive user engagement.
Make your content more discoverable
Azure AI Video Indexer enables you to extract visual and speech metadata from your videos, which can be used to build enhanced search experiences in your existing apps.
Learn about video AI
Improve engagement with your videos
Metadata extracted can be used to build powerful engagement experiences with recommendations, highlight clips and interactive videos.
Learn about video AI
Make your video apps more intelligent
Integrate cognitive video insights into your apps at scale using widgets and simple APIs without worrying about the underlying infrastructure.
Learn about video AIReady to start?
Audio and Video AI features
Video
Face detection (Limited Access)
Detect and group faces
Celebrity identification (Limited Access)
Identify celebrities and view their biographies
Custom face identification (Limited Access)
Customize the model to identify specific faces
People's detected clothing
Detect clothing items of people appearing in the video.
Observed people
Detect people spotted in the video and follow their path with bounding boxes
Object identification
Automatically identify and label objects (for example: cat, table, car, ball, etc.) when they appear
Visual content moderation
Detect and prevent explicit visual content
Keyframe extraction
Automatically detect stable keyframes
On-screen text recognition (OCR)
Extract and group text that appears on video as overlay, slides, or in the background .
Scene segmentation
Segment a video by semantic scenes
Shot detection
Detect when a shot starts and ends, based on visual analysis
Shot type detection
Detect shot types like wide, close-up, interior, face positions, and multiple faces
Rolling credits detection
Identify rolling credits at the end of the video
Black-frame detection
Identify black frames in video
Audio
Spoken content moderation
Detect explicit language and dialogue
Audio effects
Identify audio effects such as clapping, laughter, and speech.
Captioning
Create subtitles in any of three formats: WebVTT, TTML, or SRT
Translation
Translate any text, including spoken text, written text, and keywords, into more than 40 languages
Language identification
Detect the spoken language from audio
Multi-language detection
Auto-detect multiple languages in spoken text
Automated transcription
Convert speech to text in 10 languages and allow extensions
Transcript customization
Adapt transcripts to industry, market, or domain specific terms
Two-channel processing
Auto-detect speakers, balance audio, separate and merge transcripts
Noise reduction
Clear up telephony audio or noisy recordings
Speaker identification
Understand who spoke when
Speaker stats
View metrics on who spoke how much relative to other speakers
Audio + Video
Keyword extraction
Find the keywords mentioned in each segment
Topic inference
Identify main topics
Sentiment analysis
Compare levels of positive and negative sentiments throughout the audio and/or video
Named entities
Track and customize mentioned people, locations and brands in spoken or on-screen text
Textual Emotion detection
Detect emotions via transcript analysis
Other features
Inline editing
Manually edit any indexing results or output
Highlight-reel editing
Store source video once and create multiple edits of video segments
Contextual search
Search inside your videos and find smart matches from audio, video, and AI-identified insights
Widgets
Embed delightful insights and video player widgets in your website or application
Recommendations
Find related videos with similar people discussing similar topics
REST API
Easily integrate with your application using our robust REST API
Try Azure AI Video Indexer for free
Start with a free account for up to 40 indexing hours. For unlimited indexing,
create an Azure AI Video Indexer account with your Azure subscription.