Abstract: Highlights•Cultural evolution provides feedback from the social environment into individual micro-controllers.•Scalable model of self-organized aggregation, both in simulation and on real robots.•Heterogeneous and dynamic controllers in the swarm outperform optimized, but static and homogeneous, controllers.