Subjective quality assessment - "Structure preserving H.264 watermarking" database

The purpose of this page is to make available one subjective quality assessment from IRCCyN/IVC.  The experiments were conducted in our lab in normalized conditions.

The goal of the "H.264 watermarking" database is to evaluate the quality of a H.264/CAVLC video watermarking method.
One of the main objectives was to determine is the video suffered any quality loss when watermarkis were embedded (compared to the coding only scenario).

Content

4 input sequences (original color videos) were used, 56 distorted videos were generated with 2 different scenarrios (encoding only or watermarking + encoding) for each video (and each scenario) 6 quantization parameters were used (Qp=24, 28, 32, 36, 40 and 44). The original input  contents were also evaluated for both scenarios (4*2*6+4*2=56).

Details on this database can be found in the citation below.
The ACR (absolute Category Rating) protocol was used. For this protocol, a single video sequence is displayed in the center of the screen, and the observer is asked for a quality score after every displayed sequence. The resolution of the tested video sequences was 1280 x 720. The quality score was (5: Excellent, 4: Good, 3: Fair, 2: Poor, 1: Bad), MOS were computed across the 42 observers, as well as standard deviations for every content across observers, the maximum standard deviation was below 1 (0.93).
Each sequence was 10 seconds long (250 frames). For each observer, the experiment duration was in between 15 and 20 minutes.
Subjective evaluations were made at a viewing distance of 6 times the screen height. Distortions for each processing and each video have been optimized in order to uniformly cover the visibility scale.

Download

Download the IVC-H.264Wmking database


How to cite the IVC-POW database

If you use BibTeX, here's the citation:

@article{IEEE-TMM2014,
	author = {Stütz, T. and Autrusseau, F. and Uhl, A.},
	title = {Non-Blind Structure-Preserving Substitution Watermarking of H.264/CAVLC Inter-Frames},
	journal = {IEEE Transactions on Multimedia},
	year = {2014},
	volume = {16 (5)},
	pages = {1337-1349},
	url = {http://www.irccyn.ec-nantes.fr/~autrusse/Papers/TMM2014.pdf},
	doi = {http://dx.doi.org/10.1109/TMM.2014.2310595}
}

If you don't use BibTeX, use simply:

	T. Stuetz, F. Autrusseau, A. Uhl, "Non-Blind Structure-Preserving Substitution Watermarking of H.264/CAVLC Inter-Frames", 
		in IEEE Transactions on Multimedia, IEEE-TMM, 16(5), pp. 1337-1349, ISSN 1520-9210, Aug. 2014.