Unofficial Windows Media Foundation Samples

Official samples are available here and a brief overview web page here.

Update Sep 2020: A new official Media Foundation samples repository has been created at microsoft/media-foundation.

A set of minimal sample applications that demonstrate how to use certain parts of Microsoft's Windows Media Foundation API. The original motivation for these samples was an attempt to find a way to stream audio and video from a webcam, encoded as H264 and/or VP8, over RTP and then render at the remote destination. As of January 2020 the MFWebCamRtp sample has been used to stream H264 samples from a webcam source to ffplay.

Rendering

• MFAudio - Play audio from file on speaker.

• MFAudioCaptureToSAR - Capture on default audio capture device (microphone) and playback on default audio output device (speaker).

• MFBitmapMftToEVR - Performs a colour conversion on a bitmap byte array and then displays on the Enhanced Video Renderer.

• MFBitmapToEVR - Displays a byte array representing a bitmap on the Enhanced Video Renderer.

• MFTopology - Plays audio and video from an mp4 file using the Enhanced Video Renderer and Streaming Audio Renderer.

• MFVideoEVR - Display video from an mp4 file in Window WITHOUT using a topology. Write samples to video renderer directly from buffer.

• MFVideoEVRWebcam - Same as the MFVideoEVR sample but replacing the file source with a webcam.

• MFVideoEVRWebcamMFT - Same as the MFVideoEVRWebcam sample but manually wires up a color conversion MFT transform instead of setting MF_SOURCE_READER_ENABLE_VIDEO_PROCESSING on the video source reader.

• WpfMediaUWA - Initial foray into how Media Foundation can work with WPF in a Universal Windows Application (UWA). UWA is currently impractical due to deployment constraints, i.e. Windows Store only. Hopefully in 2020 with the introduction of Windows UI 3.0 using the types of controls in this sample will become practical.

Plumbing

• MFCaptureRawFramesToFile - Captures 100 samples from default webcam to file.

• MFListTransforms - Lists the available MFT Transforms to convert between two media types.

• MFMP4ToYUVWithMFT - Reads H264 encoded video frames from an mp4 file and decodes them to a YUV pixel format and dumps them to an output file.

• MFMP4ToYUVWithoutMFT - Same as the previous (MFMP4ToYUVWithMFT) sample but WITHOUT having to wire up the H264 decoder. Reads H264 encoded video frames from an mp4 file and decodes them to a YUV pixel format and dumps them to an output file.

• MFSampleGrabber - Copy of the Sample Grabber Sink example from https://docs.microsoft.com/en-us/windows/win32/medfound/using-the-sample-grabber-sink but grabbing both audio and video samples from an mp4 file rather than solely audio samples.

• MFWebCamToFile - Captures 100 samples from default webcam to an mp4 file.

Webcam -> H264 -> RTP

• MFH264RoundTrip - Captures video frames, H264 encode to byte array, decode to YUV (replicates encode, transmit, decode).

• MFWebCamRtp - Stream webcam video over RTP to ffplay.

• MFWebCamToH264Buffer - Captures the video stream from a webcam to an H264 byte array by directly using the MFT H264 Encoder.

Webcam -> H264/VP8 -> WebRTC -> Web Browser

• MFWebCamWebRTC - Stream VP8 encoded webcam video to a WebRTC client (only works with Chrome).

• MFWebCamWebRTCH264 - Not Working Stream H264 encoded webcam video to a WebRTC client.