Working with Tabular Data at Scale
Unglamorous techniques, each worth a large constant factor.
Pandas is a Python data analysis and manipulation library that provides powerful, easy-to-use data structures like DataFrames and Series. It is widely used for data cleaning, transformation, exploration, and analysis. Pandas supports CSV, Excel, SQL, and JSON formats, and integrates well with NumPy, Matplotlib, and Scikit-learn. Its intuitive syntax and rich functionality make it essential for data science, machine learning, and business analytics.
Unglamorous techniques, each worth a large constant factor.
Learn why writing through a filtered DataFrame changes nothing, what copy-on-write guarantees in pandas 3, and how to modify a table in one step.
Learn when to stack tables with concat and when to join them with merge, why duplicate keys multiply rows, and how to check a join before trusting it.
Learn how groupby splits rows, applies a function, and combines the results, why text columns raise, and how missing keys vanish from a summary.
Learn what a DataFrame index is, how loc and iloc differ, why a loc slice includes its endpoint, and when to reset the index after filtering.
A spreadsheet of support tickets, five questions, one table. Filter it, group it, join it to a lookup table, and see where pandas quietly changes the answer.
Learn how a boolean mask filters rows in pandas, why conditions need parentheses and element-wise operators, and how missing values drop out silently.
Build installable Python data jobs with explicit configuration, input validation, tests, and a deliberate policy for rejected records and reruns.