Ideas can be categorized into one of two buckets:
While we’d all love to live in a world where most ideas can be pre-rationalized with data and logic, this is not only possible, because:
This means that most ideas cannot be pre-rationalized; they can only be post-rationalized. We try them, and if they are successful, we construct a new theory of success around them, at which point others will follow in our footsteps. This is done best when you have strong experimentation guidelines.
This is often what ends up happening anyway, even when we think we are pre-rationalizing: our attempts at pre-rationalization often work only because the act of predicting the future is creating the conditions for the future to happen.
When done well, this is the only way for humanity to move forward and create the future we want to see. However, we should also keep in mind that post-rationalization can lead to survivorship bias.