How do I list all files of a directory?

In-depth concepts with os and pathlib

Looking beyond the quick-and-dirty solutions, Python's array of built-in modules, notably os and pathlib, are powerhouses for more comprehensive directory and file operations.

Wrestling large directories with os.scandir()

For wrestling with large directories, tap into the power of os.scandir(). This function, a Python 3.5 newcomer, boasts a more robust efficiency than its predecessor listdir():

import os

with os.scandir('/path/to/directory') as entries:
    files = [entry.name for entry in entries if entry.is_file()]


Recursive operation with os.walk()

To recursively list files in a directory and its child directories, os.walk() is your indomitable companion:

import os

for dirpath, dirnames, filenames in os.walk('/path/to/directory'):
    print(filenames)  # prints all the treasure in the chest
    break  # stops the walk, remove this line to explore deeper into subdirectories


Gearing up with glob

glob.glob() is your handy gear for pattern matching filenames, especially useful when sifting through files of a specific criterion:

import glob

txt_files = glob.glob('/path/to/directory/*.txt')  # Kittens of .txt files appear!


Bear in mind, however, that glob patterns operate under Unix shell rules; to ensure characters are treated literally, use the trusty glob.escape().

Advanced directory techniques for a power user

Python's rich bundle of tools provide both security and adaptability for more advanced operations.

Glob-ally safe with glob.escape()

glob.escape() can safeguard your queries, protecting you from unintended pattern expansion:

import glob

# Safeguarding file names with special characters
secure_pattern = glob.escape('/path/to/[directory]/') + '*.txt'
secure_files = glob.glob(secure_pattern)


Sleek performance with pathlib

Introduced in Python 3.4, pathlib uses an object-oriented approach for handling filesystem paths, elevating the efficiency of your operations:

from pathlib import Path

# '*.txt' carnival! Lists all .txt files within the directory and its subdirectories
all_txt_files = Path('/path/to/directory').glob('**/*.txt')


With methods such as .is_file() and .is_dir(), pathlib makes it easy to authenticate the type of filesystem entity you're dealing with.