Can Information Flows Suggest Targets for Interventions in Neural Circuits?

Praveen Venkatesh, Sanghamitra Dutta, Neil Mehta, Pulkit Grover

Keywords: information flow, interventions, neuroscience, information theory, explainability, fairness

Abstract: Motivated by neuroscientific and clinical applications, we empirically examine whether observational measures of information flow can suggest interventions. We do so by performing experiments on artificial neural networks in the context of fairness in machine learning, where the goal is to induce fairness in the system through interventions. Using our recently developed M-information flow framework, we measure the flow of information about the true label (responsible for accuracy, and hence desirable), and separately, the flow of information about a protected attribute (responsible for bias, and hence undesirable) on the edges of a trained neural network. We then compare the flow magnitudes against the effect of intervening on those edges by pruning. We show that pruning edges that carry larger information flows about the protected attribute reduces bias at the output to a greater extent. This demonstrates that M-information flow can meaningfully suggest targets for interventions, answering the title's question in the affirmative. We also evaluate bias-accuracy tradeoffs for different intervention strategies, to analyze how one might use estimates of desirable and undesirable information flows (here, accuracy and bias flows) to inform interventions that preserve the former while reducing the latter.

Code Of Conduct: I certify that all co-authors of this work have read and commit to adhering to the NeurIPS Statement on Ethics, Fairness, Inclusivity, and Code of Conduct.

TL;DR: To test whether observational measures of information flow can predict the outcomes of interventions in neuroscience, we perform analogous experiments on artificial neural networks in a fairness context and analyze bias-accuracy tradeoffs.

Code: https://github.com/praveenv253/ann-info-flow