Creating a dictionary from a csv file?

python

dataframe

pandas

csv

byAnton Shumikhin·Jan 12, 2025

To quickly create a dictionary from a CSV file, the csv module is your Pythonic Swiss-knife. For a dictionary of key-value pairs where the key is the first column, use this:

import csv

with open('file.csv', 'r') as file:
    # Repo full of records, and this, is your git diff reader 🕶
    reader = csv.reader(file)
    next(reader)  # Just like first pancakes, first rows are experimental, so we skip it
    result = {row[0]: row[1:] for row in reader}

Want nested dictionaries, where headers are acting as keys? Yes, you can:

with open('file.csv', 'r') as file:
    # Headers here enjoy their moment of fame as dictionary keys!
    result = {row['UID']: row for row in csv.DictReader(file)}

Remember to replace 'file.csv' and 'UID' with your own file and specific header key.

The pretty & swift: Pandas for large datasets

When your dataset is bigger than the biggest pumpkin in your town (or simply large), efficiency matters. A cocktail of csv.DictReader and pandas library is handy:

import pandas as pd

# Dataframe enters the scene, holding the reading glasses 🧐
df = pd.read_csv('file.csv')

# And voila! The dataframe morphs into a dictionary, 'UID' being the lucky index column
result = df.set_index('UID').to_dict('index')

To ensure a smooth transformation, and no Halloween-like surprises, specify data types upfront through dtype={} with pd.read_csv().

The treacherous roadblocks you want to dodge

Watch for uniqueness in keys to avoid setting off ValueError bombs during unpacking.
Your csv must be as consistent as your morning coffee, especially when using pandas, lest it result in unintended and spooky data changes.
If you've invited pandas to the party, be aware of its version compatibility foibles. Also, when switching to pd.Series.to_dict(), don't forget your syntax etiquette.

Side tips for your csv-to-dict journey

The more tools, the merrier

Python's ecosystem is packed with diverse tools. If you're dealing with numerical data or need performance, make sure to knock numpy's door as well.

Data preprocessing: A must-do ritual

Before you jump on converting CSV to a dictionary, invest in cleansing your data, handling its missing values, watching out for those outliers, and ensuring it's normalized.

Mesh-ups with other data bodies

Dictionaries often have to mingle with other data structures like lists, sets, and databases. Tune your dictionary to be a sociable entity in your application.

explain-codes / Python / Creating a dictionary from a csv file?

Linked

Convert a Pandas DataFrame to a dictionary



Convert list of dictionaries to a pandas DataFrame



Split a Pandas column of lists into multiple columns



Create a Pandas Dataframe by appending one row at a time



How to flatten a hierarchical index in columns

