Improve validations and error handling in new CI config entries

What does this MR do?

This MR improves validation in new CI config.

Why was this MR needed?

With that it will be easier to handle errors during validation and post-processing.

What are the relevant issue numbers?

This is a continuation of #15060 (closed)