MARKOV RANDOM FIELD BASED IMAGE INPAINTING WITH CONTEXT-AWARE LABEL SELECTION

These are the results accompanying the paper "Markov Random Field based image inpainting with context-aware label selection" submitted to the International Conference on Image Processing (ICIP) 2012.

We show separately results of:
Method 1 - the proposed efficient optimization method (explained in Sec. 3.2 of the paper) without context-aware label selection
Method 2 - complete proposed method, with label selection and efficient optimization.

We compared the proposed method with following state-of-the-art methods:
[1] Komodakis, N., Tziritas, G.: Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Trans. Image Proc., vol. 16, no. 11, 2649-2661 (2007)
[2] Le Meur, O., Gautier, J., Guillemot, C.: Examplar-based inpainting based on local geometry. In ICIP 2011, pp. 3462-3465 (2011)

Comparison of global inpainting methods

Input image
Result of [1]
Result of proposed Method 1
Result of proposed Method 2
Input image
Result of [1]
Result of proposed Method 1
Result of proposed Method 2

Comparison with state-of-the-art methods

Input image
Result of [2]
Result of [1]
Result of proposed Method 1
Result of proposed Method 2
Input image
Result of [2]
Result of [1]
Result of proposed Method 1
Result of proposed Method 2
Input image
Result of [2]
Result of [1]
Result of proposed Method 1
Result of proposed Method 2
Input image
Result of [2]
Result of [1]
Result of proposed Method 1
Result of proposed Method 2
Input image
Result of [2]
Result of [1]
Result of proposed Method 1
Result of proposed Method 2

Comparison with state-of-the-art method from [2] on images from [3]

[3] Kawai, N., Sato, T., Yokoya, N.: Image inpainting considering brightness change and spatial locality of textures and its evaluation. In PSIVT 2009, pp. 271–282 (2009).

Input image
Result of [2]
Result of proposed Method 2
Input image
Result of [2]
Result of proposed Method 2
Input image
Result of [2]
Result of proposed Method 2
Input image
Result of [2]
Result of proposed Method 2

Dependence of the result of the proposed method (Method 2) on the patch size while keeping the block division fixed (5x7 blocks)

Note that keeping the block division fixed means that the search space is the same for all patch sizes.

Input image
Patch size 7x7
Patch size 9x9
Patch size 11x11
Patch size 13x13
Patch size 15x15
Patch size 17x17

Dependence of the result of the proposed method (Method 2) on the block division while keeping the patch size fixed

Patch size is 11x11 in the first and 15x15 in the second image. Note that the number of blocks along the vertical dimension (M) is the same, but the total number of blocks in two images is different because images are of different sizes and blocks are constrained to be square.

Input image
4x5 blocks
5x7 blocks
6x8 blocks
Input image
3x4 blocks
4x6 blocks
5x7 blocks
6x9 blocks