TCD-Arena: Assessing Robustness of Time Series Causal Discovery Methods Against Assumption Violations
Keywords: Causal Discovery, Benchmark, Robustness, Time-Series, Causality
TL;DR: large scale study on the robustness of causal discovery algorithms for time series data against violations of their assumptions
Abstract: Causal Discovery (CD) is a powerful framework for scientific inquiry. Yet, its practical adoption is hindered by a reliance on strong, often unverifiable assumptions and a lack of robust performance assessment. To address these limitations and advance empirical CD evaluation, we present **TCD-Arena**, a modularized and extendable testing kit to assess the robustness of time series CD algorithms against stepwise more severe assumption violations. For demonstration, we conduct an extensive empirical study comprising over 50 million individual CD attempts and reveal nuanced robustness profiles for 27 distinct assumption violations. Further, we investigate CD ensembles and find that they can boost general robustness, which has implications for real-world applications. With this, we strive to ultimately facilitate the development of CD methods that are reliable for a diverse range of synthetic and potentially real-world data conditions.
Primary Area: datasets and benchmarks
Submission Number: 18905
Loading