Operation compare-video

The compare-video operation allows for the comparison of differences between two provided videos.
It utilizes the Video Multimethod Assessment Fusion (VMAF) video quality metric to evaluate the similarity in quality between the two videos.

VMAF is a machine learning-based video quality assessment algorithm that combines the strengths of several existing video quality metrics into a single, unified score.
It was designed to closely predict the Mean Opinion Score (MOS) of human viewers and has been shown to be highly correlated with subjective quality assessments.
By calculating the VMAF score for two videos, you can get an idea of how similar in quality the videos are to each other.

Example

{
    "conversion": [{
        "category": "operation",
        "target": "compare-video"
    }],
}
                                

Output Details

The output of this operation includes information about the quality of each frame in the video, as well as summary statistics for the entire video.
The metrics field contains a set of quality metrics for each frame, as in the following example:

{
    "version": "2.3.1",
    "fps": 24.03,
    "frames": [
    {
        "frameNum": 0,
        "metrics": {
            "integer_adm2": 0.842100,
            "integer_adm_scale0": 0.779905,
            "integer_adm_scale1": 0.749054,
            "integer_adm_scale2": 0.846122,
            "integer_adm_scale3": 0.901889,
            "integer_motion2": 0.000000,
            "integer_motion": 0.000000,
            "integer_vif_scale0": 0.198811,
            "integer_vif_scale1": 0.522634,
            "integer_vif_scale2": 0.660773,
            "integer_vif_scale3": 0.768340,
            "vmaf": 42.687407
        }
    },
    <...more frames...>
    ],
    "pooled_metrics": {
        "integer_adm2": {
        "min": 0.794626,
        "max": 0.863825,
        "mean": 0.830444,
        "harmonic_mean": 0.830332
    },
    "integer_adm_scale0": {
        "min": 0.698013,
        "max": 0.818805,
        "mean": 0.761654,
        "harmonic_mean": 0.761299
    },
    <...more metrics...>
    "vmaf": {
        "min": 40.664485,
        "max": 61.936634,
        "mean": 51.017497,
        "harmonic_mean": 50.703806
    }
}