Neural Particle Automata: Learning Self-Organizing Particle Dynamics

Neural Particle Automata: Learning Self-Organizing Particle Dynamics

Neural Particle Automata (NPA) enable particles with continuous positions and internal states to learn self-organizing behaviors by replacing fixed grid-based perception with a smooth-kernel aggregation system. This approach allows the locality of Neural Cellular Automata (NCA) to be preserved while enabling particles to operate on irregular and dynamic configurations rather than fixed lattices.

SPH-Based Perception for Dynamic Configurations

Neural Particle Automata utilize Smoothed Particle Hydrodynamics (SPH) perception to aggregate information from nearby particles within a support radius. Unlike convolutional perception in grid-based NCA, which reads from fixed neighbors, NPA particles use smooth kernels to estimate local environment properties.

These local sums estimate the following quantities:

  • Density: A scalar summary of the neighborhood.
  • Smoothed State: The kernel-averaged internal state (represented as RGB color in the provided demo).
  • Density Gradient: A vector indicating the direction of increasing particle density.
  • Moment Matrix: A summary of the local geometry of neighbors around a particle, used to correct geometric distortion.
  • State Gradients: 0th- and 1st-order estimates of how the internal state changes across the neighborhood.

State-Gradient Estimation and Geometric Correction

To estimate how the internal state changes around a center particle, NPA employs two levels of gradient estimation:

0th-Order Estimators

0th-order estimators use simple differences in state values. While these provide a basic estimate, they can be biased when particles are irregularly placed or when fields change linearly.

1st-Order Correction via Moment Matrix

To achieve exact gradient estimates for locally linear fields, NPA uses a 1st-order correction involving the moment matrix. The moment matrix summarizes how neighbor offsets and kernel-gradient directions cover the surrounding space. By multiplying the 0th-order estimate by the inverse of the moment matrix, the system normalizes out local geometric distortion, ensuring the gradient estimate remains accurate even under uneven sampling.

Community Insights and Potential Applications

Users interacting with the project have highlighted several potential extensions and theoretical parallels to biological systems:

  • Biological Morphogenesis: One observer noted the similarity between NPA and the work of Michael Levin on electrical communication between living cells, where cells structure and repair larger-scale morphology.
  • Scaling and Generative Tasks: Suggestions for application include texture synthesis, where particles could be arranged in a grid or interpolated to exploit low-contrast areas in data.
  • Structural Stability: Users observed that patterns can be disrupted to a point where they cannot re-form, suggesting a limit to the stability of the learned self-organizing patterns.
  • Future Capabilities: Potential extensions discussed by the community include the implementation of cell division within the particle system.

Sources