Abstract: Highlights•Point out that existing methods fail to learn the timing characterization completely.•Inter and intra-variable features are equally crucial for representing time series.•Bi-FI model is designed to simultaneously learn inter and intra-variable features.•Bi-FI achieves SOTA performance in three mainstream time series analysis tasks.