What is Airflow? Airflow is an open-source platform used to schedule and monitor workflows. It provides a web interface where you can launch, start or stop execution DAGs, and see the logs and status of each task. A DAG is a sequence of tasks that need to be executed. Airflow
With the technology at our disposal today, we are trusting computers to do more and more everyday things for us. While some may be skeptical, there isn’t anything as such wrong with this as the more data we generate, the more precise the algorithms powering these computers will become. However,
For those of us working with data, we are all too familiar with how difficult it can be to fully understand what we are presented with. No matter how complex, data can be difficult for us to digest and make sense of. Data visualization is an effective technique that can
In data science, the theory in practice is not always the same as reality. When working with data, it’s not uncommon to be presented with several complex problems. Fortunately, you are not alone and there are blogs, slack channels, and useful information to come to the rescue. Plenty of problems
As machine learning developers, we always need to deal with ETL processing (Extract, Transform, Load) to get data ready for our model. Airflow can help us build ETL pipelines, and visualize the results for each of the tasks in a centralized way. In this blog post, we look at some
If you want to understand machine learning algorithms, it is very important to understand basic statistics and what is behind them. Understanding how the algorithm operates gives you the option of configuring the model according to what you need, as well as explaining with more confidence the results obtained from
In statistics and ML, ensemble methods use multiple learning algorithms to obtain better predictive performance than could be obtained from any of the constituent learning algorithms alone.
Simulation can be used for emulating situations. It is used to simulate systems to be studied. This can be applied in any kind of system, banks, supermarkets, biological systems, traffic, etc. It can also be used to generate data with certain characteristics, either to complete missing information, to generate data
Whenever you want to analyze the performance of machine learning algorithms, you would need to study the root cause of the error. Concepts like bias and variance would help you understand this cause and give you insights on how to improve your model. What is Bias error? Bias error corresponds
Machine learning is one of the hottest topics nowadays. People talk about machine learning as if it is magic. Organizations are racing to integrate machine learning into their functions. Everyone talks about it, but not too many people know what it really is. It is just math and statistics plus
