It took 3 days to investigate by myself and only get a partial idea of the issue, but 5 minutes to ask for support and another 5 to get a working solution. Hopefully lesson learned.
While I might still bikeshed how the rest of the configuration is sourced, at least the import points should be stable.