How to upgrade all Python packages with pip

python

pip

package-management

upgrade-best-practices

byAlex Kataev·Nov 6, 2024

To upgrade all outdated Python packages in one command:

pip freeze --local | grep -v '^\-e' | cut -d = -f 1 | xargs -n1 pip install -U

Here's the rundown:

pip freeze --local: Get a list of locally installed packages.
grep -v '^\-e': Do not consider editable (dev) packages.
cut -d = -f 1: Extract only the package names.
xargs -n1 pip install -U: Upgrade each package individually.

Velociraptors love this method, but Jurassic pip versions (>=22.3) may need another formula:

pip list --outdated --format=json | python -c "import sys, json; [print(pkg['name']) for pkg in json.load(sys.stdin)]" | xargs -n1 pip install --upgrade

Which translates to:

pip list --outdated --format=json: Fetch outdated packages in JSON format.
python -c "...": Parse. Extract. Upgrade
xargs -n1 pip install --upgrade: Upgrade each package one-by-one (again!)

A deep dive into package upgrading

Upgrade philosophy

Running xargs -n1 ensures that, like a resilient ninja, even if one upgrade fails, the rest keep going.

An editable dilemma

Editable packages are like wild beasts. You don't just upgrade them without a plan. They are often better handled manually.

Say hello to upgrade tools

Enter the superheroes of batch upgrades: pip-review and pipupgrade. These tools offer automated solutions and enhance the upgrade process.

pip install pip-review
pip review --local --interactive

NOTE: Always check compatibility and the last update date of these tools. Superman does get old!

Making Python do pip's job

Python is like a magic wand, it can do a lot more than abracadabra. Using pkg_resources.working_set or pip.get_installed_distributions(), you can generate the list of packages for upgrading.

The 'freeze' magic

You can make a snapshot of current package versions like a Harry Potter spell: pip freeze > requirements.txt. This snapshot can then be manipulated for upgrades.

pip freeze > requirements.txt

Roll your sleeves up: upgrading scenarios and troubleshooting

When upgrades fail

Like a cat landing on its feet, if a package fails to upgrade, the rest can still be upgraded thanks to xargs -n1. Review the output from pip to understand and address the failure.

The incompatibility monster

Version conflicts? Upgrade issues? Fear not the incompatibility monster. Pinning versions in requirements.txt or using a virtual environment can help!