Addressing observational tensions in cosmology with systematics and fundamental physics