Tag: Pandas

Data Engineering End-to-End Project ??? PostgreSQL, Airflow, Docker, Pandas

In this article, we are going to get a CSV file from a remote repo, download it to the local working directory, create a local PostgreSQL table, and write this CSV data to the PostgreSQL table with write_csv_to_postgres.py script. Then, we will get the data from the table. After some mo...

How to Boost Pandas Speed And Process 10M-row Datasets in Milliseconds

“Great… another article on how to make Pandas n times faster.” I think I have said that countless times for the past three years I have been using Pandas. The most recent one I saw said, “make Pandas 71,803 times faster”. But I won’t give you that...

Pandas Library Explained

Pandas is a powerful open-source Python library that provides data structures and data analysis tools for working with structured data. It was created by Wes McKinney in 2008 and has since become a fundamental tool for data manipulation and analysis in the Python ecosystem. Pandas is particularly us...

Data Science Trends & Salaries in 2023

Data science is one of the coolest fields in recent years. Many people from different backgrounds have transitioned into this field. But, is this trend still ongoing? Today, we’ll handle the data science salaries 2023 dataset and explore trends in data science with data visualization techni...

Pandas 2.0: A Game-Changer for Data Scientists?

Due to its extensive functionality and versatility, pandas has secured a place in every data scientist’s heart. From data input/output to data cleaning and transformation, it’s nearly impossible to think about data manipulation without import pandas as pd, right? ...

Try These 3 Lesser-Known Pandas Functions

If you ask any experienced data scientist and machine learning engineer, what costs the most amount of time in their job? I guess many of them will say: data preprocessing — a step that cleans up the data and prepares it for sequential data analysis. The reason is simple — garbage in, ga...

6 Things That You Probably Didn???t Know You Could Do With Pandas

With its powerful and flexible functionalities, Pandas has become an indispensable tool for data scientists and analysts. Referring to the statistics reported by PyPI, can you imagine that Padnas receives over 3M downloads daily? Of course, this statistic gives very little informatio...

Pandas 2.0: A Game-Changer for Data Scientists?

Due to its extensive functionality and versatility, pandas has secured a place in every data scientist’s heart. From data input/output to data cleaning and transformation, it’s nearly impossible to think about data manipulation without import pandas as pd, right? ...

6 Pandas Mistakes That Silently Tell You Are a Rookie

Introduction We are all used to the big, fat, red error messages that frequently pop up while we code. Fortunately, people won’t spot it because we always fix those errors. But how about the mistakes that give no errors? These are the trickiest, but the pros could easily call them out. T...