Microsoft Video Indexer - Unlock Video Insights

Audio and Video AI features

Video

Faces

Face detection

Detect and group faces

Animated character detection

Detect, group, identify, and customize animated characters

Celebrity identification

Identify celebrities and view their biographies

Custom face identification

Customize the model to identify specific faces

Best thumbnail extraction

Automatically extract the best face images for thumbnails

Visual analysis

Visual text recognition

Extract and group written text that appears in video as overlay, slides, or background

Object identification

Automatically identify and label objects (for example: cat, table, car, ball, etc.) when they appear

Visual content moderation

Detect and prevent explicit visual content

Video analysis

Scene segmentation

Segment a video by semantic scenes

Shot detection

Detect when a shot starts and ends, based on visual analysis

Shot type detection

Detect shot types like wide, close-up, interior, face positions, and multiple faces

Rolling credits detection

Identify rolling credits at the end of the video

Black-frame detection

Identify black frames in video

Keyframe extraction

Automatically detect stable keyframes

Audio and video

Audio analysis

Keyword extraction

Find the keywords mentioned in each segment

Topic inference

Identify main topics

Named entities

Track and customize mentioned people, locations and brands in spoken or on-screen text

Sentiment analysis

Compare levels of positive and negative sentiments throughout the audio and/or video

Emotion detection

Detect emotions expressed in speech, vocal signals, and facial expressions

Spoken content moderation

Detect explicit language and dialogue

Audio effects

Identify audio effects such as clapping, silence, and speech

Speech to text

Language identification

Detect the spoken language from audio

Multi-language detection

Auto-detect multiple languages in spoken text

Automated transcription

Convert speech to text in 10 languages and allow extensions

Transcript customization

Adapt transcripts to industry, market, or domain specific terms

Captioning

Create subtitles in any of three formats: WebVTT, TTML, or SRT

Translation

Translate any text, including spoken text, written text, and keywords, into more than 40 languages

Sound and voice

Two-channel processing

Auto-detect speakers, balance audio, separate and merge transcripts

Noise reduction

Clear up telephony audio or noisy recordings

Speaker identification

Understand who spoke when

Speaker stats

View metrics on who spoke how much relative to other speakers

Other features

Inline editing

Manually edit any indexing results or output

Highlight-reel editing

Store source video once and create multiple edits of video segments

Contextual search

Search inside your videos and find smart matches from audio, video, and AI-identified insights

Widgets

Embed delightful insights and video player widgets in your website or application

Recommendations

Find related videos with similar people discussing similar topics

REST API

Easily integrate with your application using our robust REST API

learn more

Unlock video insights

Easily extract insights from your videos and quickly enrich your applications to enhance discovery and engagement

Make your content more discoverable

Improve engagement with your videos

Make your video apps more intelligent