The issue you mention should be resolved now with the Pydantic changes. Do we still have reason to make this change? I guess we could make the test suites in the config file optional, in which case you can just add a default to the field and remove the constraint.