VSUMM TOOLKIT

Analysing the color palettes in a collection of videos.

RQ: Which are the visual tones of the most-watched Amazon fires related YouTube videos?

VISUALIZATION

*CLICK HERE TO RETURN TO OVERVIEW

VIDEO FRAMES: | AMAZON FOREST FIRE | ODHIGYAN SCIENCE

STEPS

WHAT’S IT FOR

TOOLS

DETAILS AND MATERIALS

SCRAPING

DATA EXPLORATION

DATA PREPARATION

URLS CREATION

RENAMING THE NEW COLUMN

DOWNLOAD VIDEOS

COLLECTING VIDEOS IN A NEW FOLDER

FRAME EXTRACTIONS BY CHANGE OF SCENE

COLLECTING ALL THE FRAMES IN FOLDERS DIVIDED BY VIDEO

IMPORTING FRAMES OF EACH VIDEO

PLOTTING THE FRANES OF EACH VIDEO

EXPORT ALL THE FRAMES PLOTTED OF EACH VIDEO

ANNOTATE THE VISUALISATION

GET A LIST OF VIDEOS FOR EACH CHOSEN QUERY AND SELECTED TIME-FRAME.

OPEN THE YOUTUBE DATA TOOL(YDT) CSV DOWNLOADED AND EXPLORE THE DATA.

FILTER THE LIST BY ORDER OF VIEWS TO TAKE THE FIRST 10 VIDEOS AS SAMPLES.

INSIDE THE YDT.CSV THERE IS ONLY THE VIDEOS ID, BUT YOU NEED THE URL TO DOWNLOAD THEM.

TO KEEP TRACK OF THE NEW COLUMN IN WHICH WE HAVE ALL THE VIDEO URLS.

DOWNLOAD THE VIDEO SAMPLE QUICKLY AND AUTOMATICALLY.

IT’S IMPORTANT FOR THE NEXT SCRIPT THAT THE FOLDER CONTAINS ONLY THE DOWNLOADED VIDEOS.

* THE SCRIPT EXTRACTS THREE FRAMES EVERY SCENE CHANGE.

THE NEXT STEP REQUIRES HAVING THE FRAMES OF EACH VIDEO IN A SINGLE FOLDER.

INSERT ALL THE FRAMES OF ONE VIDEO AT A TIME TO RUN THE MODEL.

MEASURE BRIGHTNESS, HUE AND SATURATION OF EACH FRAME.

SAVE ALL NEW IMAGES AS A SEQUENCE OF STATIC PNGS TO BE ABLE TO ANNOTATE THEM.

CREATE VIDEOS GRID FOR EACH QUERY.

Youtube Data Tools ⟶ [Video List]

Excel ⟶ [Import Data]

Excel ⟶ [Filter-Discending]

Excel ⟶ =CONCATENA(E2;F2)

Excel

Python3 ⟶ [PyTube3]

No tool needed

Python3 ⟶ [PySceneDetect]

No tool needed

ImageJ ⟶ [Image Sequence]

ImageJ ⟶ [Stack 3D Surface Plot]

ImageJ ⟶ [Save As] ⟶ [Png sequence]

Figma

“Amazon Fires” - “Pray for Amazonia”

videoIdvideoTitlepublishedAtviewCountposition

E2 ⟩ http://www.youtube.com/watch?v=

F2 ⟶ videoId

videoUrl

LINK TO PYTHON3 DOCUMENTATION

LINK TO PYTUBE3 DOCUMENTATION

LINK TO REPOSITORY AND STEP-BY-STEP GUIDE

Rename the videos inside the folder like this:

vid1vid2vid3vid4

LINK TO PYSCENEDETECT DOCUMENTATION

LINK TO REPOSITORY AND STEP-BY-STEP GUIDE

Rename the frames inside the folder like this:

frame1frame2frame3frame4

LINK TO DOWNLOAD

LINK TO DOWNLOAD FIGMA

METODOLOGY

aim

This type of analysis allows videos to be analysed in a three-dimensional space based on hue, saturation and brightness. Frame extraction for this purpose is based on scene change detection, so that the images to be analysed are only taken once and there are no duplicates due to scene length. The algorithm used for the analysis in three-dimensional space is Stack 3D Surface Plot, a plug-in of ImageJ software.

output

The final visualisation is made up of gifs, each of which contains all the plotted frames of a video. The gifs are divided into two sections according to the collection they belong. By clicking on each gif it is possible to explore in detail the grid of static frames plotted in order of video reproduction.