Project Overview
This repository implements three saliency prediction models (CovSal, GBVS, and FES) to generate saliency maps and evaluate their alignment with human fixation patterns in Typically Developed (TD) and Autism Spectrum Disorder (ASD) groups.
Paper & Source: CovSal Project
Saliency Map Prediction Code: Download Here
- Download the code file from the provided link.
- Extract the ZIP file; it will create a folder named
saliency. - Navigate to the
saliencyfolder (ignore_MACOSXif present). - Open MATLAB and create a
.mfile. - Use
saliencymap.mto generate saliency maps.
- Open the
CovSalfolder inside the repository. - Navigate to the
saliencyfolder. - Run
generate_saliency_maps.min MATLAB to generate saliency maps for selected folders. - Modify the folder directory in the script to match your dataset location.
- Run
perform_evaluation.min MATLAB to evaluate the generated saliency maps.
Paper & Source: GBVS Project
Paper Title: Image Saliency Estimation via Random Walk Guided by Informativeness and Latent Signal Correlations
Saliency Map Prediction Code: Download Here
- Download the code file from the provided link.
- Extract the ZIP file; it will create a folder named
corSal. - Open MATLAB and create a
.mfile. - Navigate to
external/gbvs/gbvs.mto generate saliency maps.
- Open the
CovSalfolder inside the repository. - Navigate to the
corSalfolder. - Run
generate_saliency_map.min MATLAB to generate saliency maps for selected folders. - Modify the folder directory in the script to match your dataset location.
- Open the
corSalfolder and runperform_evaluation.min MATLAB.
Paper & Source: FES Paper
Saliency Map Prediction Code: GitHub Repository
- Download the code from the provided GitHub link.
- Extract the ZIP file; it will create a folder named
FES-master. - Open MATLAB and create a
.mfile. - Run
calculateImageSaliency.mto generate saliency maps.
- Open the
FES-masterfolder inside the repository. - Run
generate_saliency_map.min MATLAB to generate saliency maps for selected folders. - Modify the folder directory in the script to match your dataset location.
- Open the
FES-masterfolder and runperform_evaluation.min MATLAB.
The saliency maps generated by each model are evaluated using the following metrics:
- AUC_Borji (Area Under Curve - Borji)
- AUC_Judd (Area Under Curve - Judd)
- AUC_shuffled (Shuffled AUC)
- CC (Correlation Coefficient)
- EMD (Earth Mover’s Distance)
- Info Gain (Information Gain)
- KLdiv (Kullback-Leibler Divergence)
- NSS (Normalized Scanpath Saliency)
- Use
perform_evaluation.min each folder (saliency,corSal,FES-master). - The same evaluation script is used for all models.
- Ensure the paths are set correctly:
td_fixation_folderandasd_fixation_foldershould point to the respective fixation files.prediction_foldershould be set to the saliency map folder generated by each model.
The dataset used in this project can be downloaded from: Dataset Link
Duan H, Zhai G, Min X, Che Z, Fang Y, Yang X, Gutiérrez J, Callet PL. A dataset of eye movements for the children with autism spectrum disorder. In Proceedings of the 10th ACM Multimedia Systems Conference 2019 Jun 18 (pp. 255-260).
- CovSal, GBVS, and FES implementations are sourced from the respective research papers.
- We acknowledge the original authors for their contributions to saliency map research.