Embracing the Unknown: Lessons from Chaos Theory for Data Scientists
<p><strong>Sometimes during a data science project, you discover that it’s really hard to improve your metric. You try many things: complex models, adding more data, hyperparameter tuning, feature engineering, feature selection, everything. It just doesn’t get better. You can’t even improve the baseline, which was a simple moving average. What is happening? In such cases, maybe you should stop trying because something else is going on.</strong></p>
<p>In this post, I want to share why it is not always possible to get good predictions. In specific projects, you might be dealing with chaos. Not in the normal sense of the word (complete chaos or randomness), but with scientific chaos. A chaotic system is really hard or impossible to predict, especially in the long term.</p>
<p><a href="https://medium.com/bigdatarepublic/embracing-the-unknown-lessons-from-chaos-theory-for-data-scientists-a992e8478600"><strong>Read More</strong></a></p>