OSI Verification

Open Source Investigations Verification

This tutorial is about performing forensic analysis on social media to verify its authenticity. Often this type of analysis is used in determining:

  • Whether social media, like photographs or videos, really depict what they purport;
  • Fact-checking breaking news events and their chronology based on open source information, such as social media posts;
  • Verifying user accounts that make statements made on public social media;
  • Geo-locating visual media based on content in the imagery.

Qualities of Open Source Investigations Verification

It’s important that reporters or human rights investigators/researchers who intend to use any content or information obtained from social media maintain a strong sense of skepticism about the veracity of content. Reporters and researchers are often tricked by trolls, users, and other actors whose intent is to misinform for various reasons. These actors will often play to a person’s human weaknesses, which is manufacturing content that elicits an emotional reaction, foments excitement, or closely aligns with real content. Remember: If it’s too good to be true, it probably is.

  • Be skeptical.
  • Never assume.
  • Be diligent.

Double-check URLs, accounts, and a provider’s previous posts.

Find the Provenance of Information

It’s important to find the origin or provenance of online information. Often, people repost information from other sources. In many cases, the information is reformatted, rebranded, or copied in such ways to mimic original content. The reasons vary, but original content can be monetized easier than reposts.

When researching online media, try to find the original source.

Often, the first steps in authenticating social media content is finding the origin of the content. Finding the original source can be tricky, but this is often the goal in many verification processes. There are a number of tools you can employ, we’ll go over some of them below.

Google Reverse image search is an indispensable tool in the social media verification process. Google, as well as a few other social media services, allow you to search by an image. It will reveal if the same image, or videos with the image, have been uploaded before. If it can’t locate any exact matches, it will return visually similar images.

https://images.google.com/

Using one of these services is rather simple. One example was when Senator James Inhofe showed in 2015 a photograph on the senate floor, what purportedly was Russian tanks entering the Ukraine. When bloggers performed a reverse image search, they discovered the photograph was from another separate incident entirely.

Sen. James Inhofe showing fake images on Senate floor, discovered by reverse image search.

Senator reverse image example

Another service that does reverse image search is the Russian site Yandex:

https://yandex.com/images/

Yandex can sometimes provide results that Google cannot.

Other reverse image search tools:

Scanning Metadata from Images

There are a number of tools for finding metadata inside images, videos, and other documents.

Foto forensics screenshot

http://fotoforensics.com/

Foto forensics is a great tool for looking at metadata, but it’s not foolproof. This data can easily be manipulated by anyone with some technical skills. But it adds to all of the evidence you might use in building a case for authenticity verification.

Foto forensics shows you metadata

Video (and photo) Metadata

There is a command line tool (run from the Terminal on a Mac) that can extract metadata, sometimes called EXIF data, from videos and images. This command line tool, called ExifTool, can be install using Homebrew on a Mac.

ExifTool (both photo and video)

Once installed, to view metadata, the command you type in Terminal is:

exiftool name_of_photo.jpg

ExifTool

YouTube Data Viewer

Amnesty International runs a website that can show metadata associated with YouTube videos. The most beneifical data to come from this is the upload data, which is useful in determining provenence.

https://citizenevidence.amnestyusa.org/

Amnesty International YouTube Data Viewer screenshot

PDF Metadata

A command line program called XPDF can extract text and metadata from PDF files. XPDF can be installed through Homebrew.

#outputs the metadata for the pdf
pdfinfo name_of_file.pdf

#saves all text embedded in PDF to a text file
pdftotext name_of_file.pdf

PDF metadata

Online Metadata Search Tool (DOC, PDF, Images, Videos)

There are some online tools for extracting metadata from PDFs, including www.get-metadata.com.

www.get-metadata.com

Get Metadata.com

YouTube Video Search by Location

When breaking news occurs, sometimes you want to search for YouTube videos by a particular location. There are numerous tools online to faciliate this. One such tool is YouTube’s own Geo Seach tool on GitHub.

http://youtube.github.io/geo-search-tool/search.html

YouTube Geo Search Github

Determining Time from Shadows in an Image

The website SunCalc can show you which direction shadows are pointing anywhere on earth, on any given date. This can be useful in determining location or time in some images. It’s important to not rely too heavily on this information, as measuring shadows is only a very rough approximation. But corroborating shadow direction can help aid in provind authenticity of an image.

http://suncalc.net

YouTube Geo Search Github

Weather on specific date

WolframAlpha and Weather Underground both provide historical weather data.

Weather Search

Online Sleuthing Tools

The website IntelTechniques.com contains several tools useful for online sleuthing, particularly useful in situation where you’re trying to corroborate details found through social media.

https://inteltechniques.com/menu.html

Intel Techniques Website

For more in depth information, join our comprehensive workshop on Open Source Investigations. 

By Jeremy Rue & Richard Koci Hernandez

Republishing Policy

This content may not be republished in print or digital form without express written permission from Berkeley Advanced Media Institute. Please see our Content Redistribution Policy.

Upcoming Workshops:

TBA