Foraging with the Eyes: Dynamics in Human Visual Gaze and Deep Predictive Modeling

Basic Information

• Paper ID: 2510.09299
• Title: Foraging with the Eyes: Dynamics in Human Visual Gaze and Deep Predictive Modeling
• Author: Tejaswi V. Panchagnula (Indian Institute of Technology Madras)
• Classification: cs.CV (Computer Vision), eess.IV (Image and Video Processing)
• Publication Date: July 2025 (arXiv preprint)
• Paper Link: https://arxiv.org/abs/2510.09299

Abstract

This study reveals that human visual gaze trajectories follow Lévy walk patterns similar to animal foraging behavior—random trajectories with heavy-tailed step-length distributions that exhibit optimal properties in sparse resource environments. Through large-scale experiments involving 40 participants viewing 50 different images, the research team recorded over 4 million gaze points. Analysis demonstrates that human eye gaze trajectories indeed follow Lévy walk patterns, indicating that the eye forages for visual information with optimal efficiency. Furthermore, the researchers trained a convolutional neural network to predict gaze heatmaps, with the model accurately reproducing salient gaze regions, demonstrating that key components of gaze behavior can be learned solely from visual structure.

Research Background and Motivation

Problem Definition

Traditional visual attention models primarily focus on image-based saliency prediction, treating gaze behavior as a static prediction problem while ignoring the spatiotemporal dynamics of eye movements. Existing research exhibits the following limitations:

1. Missing Temporal Information: Most models collapse gaze point sequences into static heatmaps, overlooking the temporal characteristics of gaze
2. Short Exposure Bias: Standard 2-3 second free-viewing protocols favor early saliency-driven fixations, insufficiently sampling exploratory gaze behavior
3. Lack of Statistical Physics Perspective: Overlooking statistical regularities and optimization principles that eye movements may follow

Research Significance

Understanding the spatiotemporal patterns of human visual exploration is important for:

• Attention modeling and cognitive science
• Visual interface design
• Human-computer interaction systems
• Clinical diagnosis (e.g., early markers of neurological disorders such as autism and ADHD)

Innovation Motivation

Inspired by movement ecology and statistical physics, researchers discovered that both human movement patterns and animal foraging behavior exhibit Lévy walk characteristics with power-law step-length distributions. This prompted the authors to explore whether visual exploration also follows similar statistical regularities.

Core Contributions

1. First Confirmation that Human Gaze Trajectories Follow Lévy Walk Patterns: Through large-scale eye-tracking data analysis, discovering that step-length distributions for individual images exhibit power-law decay with exponents in the range 1 < μ ≤ 3
2. Construction of Large-Scale, High-Quality Eye-Tracking Dataset: 40 subjects × 50 images × 30-second viewing time, totaling over 4 million gaze points
3. Proposed MobileNetV2-Based Gaze Prediction Model: Capable of accurately predicting gaze heatmaps with robust performance across various image types
4. Revealed Optimization Principles of Visual Information Foraging: Demonstrating that the human eye employs optimal foraging strategies for visual information search
5. Discovered Correlation Between Image Entropy and Lévy Parameters: High-entropy images tend to produce larger step-length distribution parameters

Methodology Details

Task Definition

The research comprises two main tasks:

1. Statistical Analysis Task: Analyzing statistical properties of human gaze trajectories and verifying the Lévy walk hypothesis
2. Predictive Modeling Task: Predicting gaze heatmap distributions from static images

Input: RGB image I ∈ R^(3×224×224)
Output: Gaze probability heatmap Ĥ ∈ R^(1×112×112)

Experimental Design

Data Collection

• Equipment: Aurora Smart Eye Tracker (120Hz sampling rate)
• Display: Standard 1920×1080 pixel monitor
• Viewing Conditions: 30 seconds per image with 5-second black screen intervals between images
• Image Types: 50 images comprising paintings, real scenes, and abstract art, divided into two groups matched by entropy distribution

Statistical Analysis Methods

1. Step-Length Calculation: Euclidean distance d = √(x_{i+1}-x_i)² + (y_{i+1}-y_i)²
2. Turning Angle Analysis: Distribution of angles between consecutive triplets of points
3. Power-Law Fitting: Linear regression analysis on log-log scale

Model Architecture

Encoder-Decoder Structure

The model employs a U-Net architecture based on MobileNetV2:

Encoder: MobileNetV2 (ImageNet pre-trained)

• Input: I ∈ R^(3×224×224)
• Output: Feature tensor F ∈ R^(C×H'×W')

Decoder: Sequence of transposed convolution layers

• Input: Deep-layer features F
• Output: Gaze heatmap Ĥ ∈ R^(1×112×112)

Overall mapping relationship: Ĥ = D(E(I))

Loss Function Design

A composite loss function is employed to balance reconstruction accuracy and distribution fidelity:

L = α·BCE(Ĥ,H) + β·MSE(Ĥ,H) + γ·D_KL(H||Ĥ)

Where:

• BCE: Binary cross-entropy loss
• MSE: Mean squared error
• D_KL: Kullback-Leibler divergence
• Weight settings: α=0.4, β=0.3, γ=0.3

Technical Innovations

1. Transition from Sequence Prediction to Distribution Prediction: Avoiding instability and local optima issues of RNN-based temporal models
2. Long-Duration Viewing Experiments: 30-second viewing time adequately captures exploratory gaze behavior
3. Multi-Scale Statistical Analysis: Comprehensive characterization of gaze dynamics combining step-length distribution and turning angle analysis
4. Biology-Inspired Modeling: Introducing Lévy walk theory into visual attention modeling

Experimental Setup

Dataset Characteristics

• Scale: 40 subjects, 50 images, approximately 110,000 data points per subject
• Image Types: Paintings, real scenes, abstract art
• Entropy Matching: Two image groups matched by Shannon entropy distribution
• Duration: 30-second viewing time per image

Evaluation Metrics

• Statistical Metrics: Power-law exponent μ, correlation coefficients
• Prediction Metrics: Composite loss function (BCE+MSE+KL divergence)
• Qualitative Assessment: Visual comparison analysis of heatmaps

Implementation Details

• Optimizer: AdamW with cosine annealing
• Training Epochs: 10 epochs
• Data Split: 85% training, 15% validation
• Heatmap Generation: 2D Gaussian kernel convolution, downsampled to 112×112

Experimental Results

Main Statistical Findings

Step-Length Distribution Analysis

1. Cumulative Distribution: All merged data exhibits power-law decay with slope approximately -3.5, consistent with Gaussian random walk characteristics
2. Single-Image Conditional Distribution: Step-length distribution slopes for each image approximately -2.2, within the Lévy walk range (1 < μ ≤ 3)
3. Individual Conditional Distribution: Single-subject distributions similarly exhibit Lévy characteristics with slopes approximately -2.41

Turning Angle Distribution

• Bimodal distribution with significant peaks at ±π/2
• Sharp peaks at 0 and ±π indicating preference for linear motion and occasional direction reversals

Entropy-Lévy Parameter Correlation

Weak positive correlation between image entropy and μ coefficient, with high-entropy images tending to produce larger step lengths, possibly due to more widespread information distribution.

Predictive Model Results

Training Performance

• Training and validation loss curves closely aligned, indicating good generalization ability
• All three components of composite loss converge stably
• Convergence achieved after 10 training epochs

Prediction Quality

• Accurately locates high-attention regions
• Maintains spatially separated multimodal structures
• Robust performance across different image types

Model Limitations

Despite good heatmap prediction performance, the model cannot capture the heavy-tailed jump features observed in human data, highlighting limitations of current saliency learning frameworks.

Related Work

Traditional Attention Models

• Judd et al. (2009): Used low-to-mid-level image features to predict fixation density maps, but ignored top-down semantic information
• Xu et al. (2014): Three-layer model combining pixel, object, and semantic-level features, improving prediction accuracy

Movement Ecology Research

• Brockmann et al. (2006): Human movement patterns exhibit power-law step-length distributions
• Viswanathan et al. (1996, 2000): Optimality of Lévy walks in sparse environment search

Novelty of This Work

First systematic application of Lévy walk theory to human visual attention modeling, bridging the gap between static saliency models and dynamic gaze behavior.

Conclusions and Discussion

Main Conclusions

1. Human Gaze Follows Lévy Walks: Step-length distributions under individual image conditions exhibit power-law characteristics
2. Optimization of Visual Information Foraging: The human eye employs optimal strategies similar to animal foraging
3. Feasibility of Spatial Prediction: CNN models can effectively learn spatial distribution patterns of gaze
4. Significant Individual Differences: Gaze behavior exhibits randomness and individual specificity

Limitations

1. Missing Temporal Modeling: Current model cannot generate complete saccade paths
2. Insufficient Individual Difference Modeling: Model does not account for individual-specific gaze patterns
3. Limited Semantic Information: Primarily based on low-level visual features, lacking high-level semantic understanding
4. Limited Evaluation Metrics: Traditional pixel-level metrics may underestimate perceptual similarity

Future Directions

1. Temporal Extension: Adding temporal modules to spatial predictions to generate saccade paths
2. Personalized Modeling: Attention models accounting for individual differences
3. Clinical Applications: Using statistical deviations as early diagnostic markers for neurological disorders
4. Real-Time Interaction: Developing adaptive interfaces based on gaze prediction

In-Depth Evaluation

Strengths

Theoretical Contributions

1. Interdisciplinary Innovation: Successfully introducing biological foraging theory into computer vision
2. Important Statistical Findings: Discovery of Lévy walk characteristics provides new perspective for understanding visual attention
3. Rigorous Experimental Design: Long-duration viewing experiments better capture natural gaze behavior

Technical Advantages

1. Large Data Scale: 4 million gaze points dataset is large-scale for this field
2. Comprehensive Analysis: Multi-dimensional statistical analysis combining step-length distribution and turning angles
3. Practical Model: Lightweight architecture based on MobileNetV2 suitable for real-world applications

Experimental Sufficiency

1. Multiple Image Types: Covering paintings, real scenes, and abstract art
2. Statistical Power: 40 subjects provide adequate statistical power
3. Multi-Angle Verification: Hypothesis verification from individual, image, and overall perspectives

Weaknesses

Methodological Limitations

1. Loss of Temporal Information: Abandoning sequence prediction may miss important temporal dynamics
2. Unclear Causality: Failing to establish causal relationships between image features and Lévy parameters
3. Limited Model Interpretability: CNN black-box nature restricts understanding of gaze mechanisms

Experimental Design Flaws

1. Subject Representativeness: Demographic characteristics of 40 subjects not thoroughly reported
2. Image Selection Bias: Selection criteria and representativeness of 50 images insufficiently clarified
3. Insufficient Control Variables: Inadequate control of viewing distance, ambient lighting, and other factors

Insufficient Analysis

1. Shallow Individual Difference Analysis: While individual differences are mentioned, analysis lacks depth
2. Overlooked Semantic Factors: Insufficient consideration of image semantic content's influence on gaze patterns
3. Missing Cross-Cultural Validation: All subjects appear to come from the same cultural background

Impact Assessment

Academic Contribution

1. Pioneering Research: Introducing Lévy walk theory into visual attention modeling is groundbreaking
2. Methodological Value: Provides new statistical framework for eye-tracking data analysis
3. Cross-Disciplinary Impact: Potential influence on cognitive science, neuroscience, and related fields

Practical Value

1. Interface Design: Provides theoretical foundation for adaptive user interface design
2. Clinical Applications: Potential application of abnormal gaze pattern detection in disease diagnosis
3. Educational Technology: Optimizing content presentation in online learning platforms

Reproducibility

1. Detailed Method Description: Experimental procedures and analysis methods sufficiently described
2. Code Availability: Code and data openness not explicitly mentioned
3. Reasonable Hardware Requirements: Using standard eye-tracking equipment with moderate reproduction barriers

Applicable Scenarios

Direct Applications

1. Attention Modeling Research: Providing new tools for visual attention theory research
2. Eye-Tracking Data Analysis: Providing reference framework for statistical analysis of other eye-tracking experiments
3. Saliency Prediction: Predicting visually salient regions in computer vision tasks

Extended Applications

1. Medical Diagnosis: Developing neurological disease screening tools based on gaze patterns
2. Human-Computer Interaction: Designing more intelligent visual interfaces and interaction systems
3. Advertisement Design: Optimizing visual content layout to enhance attention capture
4. Virtual Reality: Enabling more natural visual interaction in VR/AR environments

References

The paper cites 13 important references, covering:

• Classical attention models: Judd et al. (2009), Xu et al. (2014)
• Lévy walk theory: Viswanathan et al. (1996, 2000, 2008)
• Human movement patterns: Brockmann et al. (2006)
• Eye movement physiology: Martinez-Conde et al. (2013)
• Information theory foundations: Attneave (1954), Wu et al. (2013)
• Evaluation metrics: Bylinskii et al. (2018)

Overall Assessment: This is an interdisciplinary research paper with significant theoretical value and practical significance. By introducing biological foraging theory into visual attention modeling, it provides a novel research perspective for the field. Despite limitations in temporal modeling and individual difference analysis, its statistical findings and modeling framework establish important foundations for future research. The paper's rigorous experimental design and comprehensive data analysis lend strong credibility to its conclusions, with important application prospects in both academia and industry.