A vision-based fully automated approach to robust image cropping detection

Fabio Bellavia, Fabio Bellavia, Marco Fanfani, Massimo Iuliani, Alessandro Piva, Carlo Colombo

Research output: Contribution to journalArticle

Abstract

The definition of valid and robust methodologies for assessing the authenticity of digital information is nowadays critical to contrast social manipulation through the media. A key research topic in multimedia forensics is the development of methods for detecting tampered content in large image collections without any human intervention. This paper introduces AMARCORD (Automatic Manhattan-scene AsymmetRically CrOpped imageRy Detector), a fully automated detector for exposing evidences of asymmetrical image cropping on Manhattan-World scenes. The proposed solution estimates and exploits the camera principal point, i.e., a physical feature extracted directly from the image content that is quite insensitive to image processing operations, such as compression and resizing, typical of social media platforms. Robust computer vision techniques are employed throughout, so as to cope with large sources of noise in the data and improve detection performance. The method leverages a novel metric based on robust statistics, and is also capable to decide autonomously whether the image at hand is tractable or not. The results of an extensive experimental evaluation covering several cropping scenarios demonstrate the effectiveness and robustness of our approach
Original languageEnglish
Pages (from-to)1-13
Number of pages13
JournalSIGNAL PROCESSING-IMAGE COMMUNICATION
Volume80
Publication statusPublished - 2020

Fingerprint

Detectors
Computer vision
Image processing
Cameras
Statistics

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Cite this

Bellavia, F., Bellavia, F., Fanfani, M., Iuliani, M., Piva, A., & Colombo, C. (2020). A vision-based fully automated approach to robust image cropping detection. SIGNAL PROCESSING-IMAGE COMMUNICATION, 80, 1-13.

A vision-based fully automated approach to robust image cropping detection. / Bellavia, Fabio; Bellavia, Fabio; Fanfani, Marco; Iuliani, Massimo; Piva, Alessandro; Colombo, Carlo.

In: SIGNAL PROCESSING-IMAGE COMMUNICATION, Vol. 80, 2020, p. 1-13.

Research output: Contribution to journalArticle

Bellavia, F, Bellavia, F, Fanfani, M, Iuliani, M, Piva, A & Colombo, C 2020, 'A vision-based fully automated approach to robust image cropping detection', SIGNAL PROCESSING-IMAGE COMMUNICATION, vol. 80, pp. 1-13.
Bellavia, Fabio ; Bellavia, Fabio ; Fanfani, Marco ; Iuliani, Massimo ; Piva, Alessandro ; Colombo, Carlo. / A vision-based fully automated approach to robust image cropping detection. In: SIGNAL PROCESSING-IMAGE COMMUNICATION. 2020 ; Vol. 80. pp. 1-13.
@article{95bfae70e227470eafcbab8041685b11,
title = "A vision-based fully automated approach to robust image cropping detection",
abstract = "The definition of valid and robust methodologies for assessing the authenticity of digital information is nowadays critical to contrast social manipulation through the media. A key research topic in multimedia forensics is the development of methods for detecting tampered content in large image collections without any human intervention. This paper introduces AMARCORD (Automatic Manhattan-scene AsymmetRically CrOpped imageRy Detector), a fully automated detector for exposing evidences of asymmetrical image cropping on Manhattan-World scenes. The proposed solution estimates and exploits the camera principal point, i.e., a physical feature extracted directly from the image content that is quite insensitive to image processing operations, such as compression and resizing, typical of social media platforms. Robust computer vision techniques are employed throughout, so as to cope with large sources of noise in the data and improve detection performance. The method leverages a novel metric based on robust statistics, and is also capable to decide autonomously whether the image at hand is tractable or not. The results of an extensive experimental evaluation covering several cropping scenarios demonstrate the effectiveness and robustness of our approach",
author = "Fabio Bellavia and Fabio Bellavia and Marco Fanfani and Massimo Iuliani and Alessandro Piva and Carlo Colombo",
year = "2020",
language = "English",
volume = "80",
pages = "1--13",
journal = "SIGNAL PROCESSING-IMAGE COMMUNICATION",
issn = "0923-5965",

}

TY - JOUR

T1 - A vision-based fully automated approach to robust image cropping detection

AU - Bellavia, Fabio

AU - Bellavia, Fabio

AU - Fanfani, Marco

AU - Iuliani, Massimo

AU - Piva, Alessandro

AU - Colombo, Carlo

PY - 2020

Y1 - 2020

N2 - The definition of valid and robust methodologies for assessing the authenticity of digital information is nowadays critical to contrast social manipulation through the media. A key research topic in multimedia forensics is the development of methods for detecting tampered content in large image collections without any human intervention. This paper introduces AMARCORD (Automatic Manhattan-scene AsymmetRically CrOpped imageRy Detector), a fully automated detector for exposing evidences of asymmetrical image cropping on Manhattan-World scenes. The proposed solution estimates and exploits the camera principal point, i.e., a physical feature extracted directly from the image content that is quite insensitive to image processing operations, such as compression and resizing, typical of social media platforms. Robust computer vision techniques are employed throughout, so as to cope with large sources of noise in the data and improve detection performance. The method leverages a novel metric based on robust statistics, and is also capable to decide autonomously whether the image at hand is tractable or not. The results of an extensive experimental evaluation covering several cropping scenarios demonstrate the effectiveness and robustness of our approach

AB - The definition of valid and robust methodologies for assessing the authenticity of digital information is nowadays critical to contrast social manipulation through the media. A key research topic in multimedia forensics is the development of methods for detecting tampered content in large image collections without any human intervention. This paper introduces AMARCORD (Automatic Manhattan-scene AsymmetRically CrOpped imageRy Detector), a fully automated detector for exposing evidences of asymmetrical image cropping on Manhattan-World scenes. The proposed solution estimates and exploits the camera principal point, i.e., a physical feature extracted directly from the image content that is quite insensitive to image processing operations, such as compression and resizing, typical of social media platforms. Robust computer vision techniques are employed throughout, so as to cope with large sources of noise in the data and improve detection performance. The method leverages a novel metric based on robust statistics, and is also capable to decide autonomously whether the image at hand is tractable or not. The results of an extensive experimental evaluation covering several cropping scenarios demonstrate the effectiveness and robustness of our approach

UR - http://hdl.handle.net/10447/385487

UR - https://www.journals.elsevier.com/signal-processing-image-communication

M3 - Article

VL - 80

SP - 1

EP - 13

JO - SIGNAL PROCESSING-IMAGE COMMUNICATION

JF - SIGNAL PROCESSING-IMAGE COMMUNICATION

SN - 0923-5965

ER -