Python opening all files in a directory

Opening and reading all the files in a directory in python

Just use instead; Solution 4: This also creates a file containing all the files you wanted to print. More information around here : https://docs.python.org/fr/3/library/functions.html#open On a side note, in order to list files, you might want to have a look to glob and use : Solution 2: You should use file open for this.

Opening and reading all the files in a directory in python

I’d like to read the contents of every file in a folder/directory and then print them at the end (I eventually want to pick out bits and pieces from the individual files and put them in a separate document) So far I have this code

import os path = 'results/' fileList = os.listdir(path) for i in fileList: file = open(os.path.join('results/'+ i), 'r') allLines = file.readlines() print(allLines) 

at the end I dont get any errors but it only prints the contents of the last file in my folder in a series of strings and I want to make sure its reading every file so I can then access the data I want from each file. I’ve looked online and I cant find where I’m going wrong. Is there any way of making sure the loop is iterating over all my files and reading all of them?

also i get the same result when I use

 file = open(os.path.join('results/',i), 'r') 

Please help I’m so lost Thanks!!

• Separate the different functions of the thing you want to do.
• Use generators wherever possible. Especially if there are a lot of files or large files

Imports

from pathlib import Path import sys 

Deciding which files to process:

source_dir = Path('results/') files = source_dir.iterdir() 

[Optional] Filter files

For example, if you only need files with extension .ext

Process files

def process_files(files): for file in files: with file.open('r') as file_handle : for line in file_handle: # do your thing yield line 

Save the lines you want to keep

def save_lines(lines, output_file=sys.std_out): for line in lines: output_file.write(line) 

you forgot indentation at this line allLines = file.readlines() and maybe you can try that :

import os allLines = [] path = 'results/' fileList = os.listdir(path) for file in fileList: file = open(os.path.join('results/'+ i), 'r') allLines.append(file.read()) print(allLines) 

You forgot to indent this line allLines.append(file.read()) . Because it was outside the loop, it only appended the file variable to the list after the for loop was finished. So it only appended the last value of the file variable that remained after the loop. Also, you should not use readlines() in this way. Just use read() instead;

import os allLines = [] path = 'results/' fileList = os.listdir(path) for file in fileList: file = open(os.path.join('results/'+ i), 'r') allLines.append(file.read()) print(allLines) 

This also creates a file containing all the files you wanted to print.

rootdir= your folder, like 'C:\\Users\\you\\folder\\' import os f = open('final_file.txt', 'a') for root, dirs, files in os.walk(rootdir): for filename in files: data = open(full_name).read() f.write(data + "\n") f.close() 

Python Directory and Files Management, All files and sub-directories inside a directory can be retrieved using the listdir () method. This method takes in a path and returns a list of subdirectories and files in that path. If no path is specified, it returns the list of subdirectories and files from the current working directory.

Scan for all determined files inside a folder using python [duplicate]

I need to write a code in python that can scan for all files inside a folder containing determined extensions like .exe, . jpg, .pdf .

Just like the linux command «ls | grep *.pdf»

I’ve tried to use a list containing all extensions i need and used Regular Expressions to search for it inside the folder. But i don’t know what to put inside re.search()

I don’t want to use something like «os» library because this script needs to work on Linux and Windows.

#!/usr/bin/python import re file_types = [".exe", ".jpg", ".pdf", ".png", ".txt"] for line in file_types: # Do something like "ls | grep * + line" namefile = re.search(line, i_dont_know_what_to_put_here) print(namefile) 

Update: Thank guys for help, i used glob library and it’s works!

You can avoid the os module by using the glob module, which can filter files by regular expression (i.e. *.py)

from glob import glob file_types = [".exe", ".jpg", ".pdf", ".png", ".txt"] path = "path/to/files/*<>" fnames = [ fname for fnames in [[fname for fname in glob( path.format( ext ))] for ext in file_types] for fname in fnames] 

Hard to read but it’s equivalent is:

from glob import glob file_types = [".exe", ".jpg", ".pdf", ".png", ".txt"] fnames = [] for ext in file_types: for fname in glob( path.format( ext )): fnames.append( fname ) 

EDIT: I’m not sure how this works cross platform as some other answers have considered.

EDIT2: glob may have unexpected side effects when used in windows. Getting Every File in a Windows Directory

import os file_types = ["exe", "jpg", "pdf", "png", "txt"] files = [f for f in os.listdir('.') if os.path.isfile(f)] # filter on file type files = [f for f in files if f.split('.')[-1] in file_types] 

In general the os and os.path module is going to be very useful to you here. You could use a regex, but unless performance is very important I wouldn’t bother.

Adding to the other comments here, if you still wish to use re, the way you should use it is:

so in your case lets say you have filetype = «.pdf», your code will be:

re.search(".*\<>".format(filetype), filename) 

where .* means «match any character 0 or more times», and the ‘\’ along with the «.pdf» will mean «where the name contains .pdf» (the \ is an escape char so the dot won’t be translated to regex). I believe you can also add a $ at the end of the regex to say «this is the end of the string».

And as mentioned here — os.listdir works perfectly fine for both Windows & Linux.

My suggestion (it will work on all OS — Windows, Linux and macOS):

import os file_types = [".exe", ".jpg", ".pdf", ".png", ".txt"] files = [entry.path for entry in os.scandir('.') if entry.is_file() and os.path.splitext(entry.name)[1] in file_types] 

or (if you want just filenames instead of full paths):

files = [entry.name for entry in os.scandir('.') if entry.is_file() and os.path.splitext(entry.name)[1] in file_types] 

Python program to delete files inside a folder Code Example, os.remove() removes a file. os.rmdir() removes an empty directory. shutil.rmtree() deletes a directory and all its contents.

Python – List Files in a Directory

Directory also sometimes known as a folder are unit organizational structure in computer’s file system for storing and locating files or more folders. Python now supports a number of APIs to list the directory contents. For instance, we can use the Path.iterdir, os.scandir, os.walk, Path.rglob, or os.listdir functions.

Directory in use: gfg

Method 1: Os module

• os.listdir() method gets the list of all files and directories in a specified directory. By default, it is the current directory.

Return Type : returns a list of all files and directories in the specified path

Источник

Open All the Files in a Directory in Python

1. Open All Files in a Folder/Dictionary Using os.walk() in Python
2. Open All the Files in a Folder/Directory With the os.listdir() Function in Python
3. Open All the Files in a Folder/Directory With the glob.glob() Function in Python

You can mainly use three methods to open all files inside a directory in Python: the os.listdir() function, os.walk() function and the glob.glob() function. This tutorial will introduce the methods to open all the files in a directory in Python. We’ve also included program examples you can follow.

Open All Files in a Folder/Dictionary Using os.walk() in Python

Various OS modules in Python programming allow multiple methods to interact with the file system. It has a walk() function that will enable us to list all the files in a specific path by traversing the directory either bottom-up or top-down and returning three tuples — root, dir, and files.

In the above syntax, r is to read the root folder or directory, and the parameter pathname is the path of the folder.

import os for root, dirs, files in os.walk(r'/content/drive/MyDrive/Skin Cancer'):  for file in files:  if file.endswith('.zip'):  print(os.path.join(root, file)) 

In the code, we first imported the OS module. Then in the read mode, we used a for loop and passed the pathname to the walk function.

The loop iterates through all files that meet the file extension condition. The above code will read all files with a .zip extension.

/content/drive/MyDrive/Skin Cancer/archive.zip 

As you can see, the Google drive Skin Cancer folder contains one zip file.

Open All the Files in a Folder/Directory With the os.listdir() Function in Python

The listdir() function inside the os module is used to list all the files inside a specified directory. This function takes the specified directory path as an input parameter and returns the names of all the files inside that directory. We can iterate through all the files inside a specific directory using the os.listdir() function and open them with the open() function in Python.

The following code example shows us how we can open all the files in a directory with the os.listdir() and open() functions.

import os  for filename in os.listdir("files"):  with open(os.path.join("files", filename), 'r') as f:  text = f.read()  print(text) 

This is the first file. This is the second file. This is the last file. 

We read the text from the three files inside the files/ directory and printed it on the terminal in the code above. We first used a for/in loop with the os.listdir() function to iterate through each file found inside the files directory. We then opened each file in read mode with the open() function and printed the text inside each file.

Open All the Files in a Folder/Directory With the glob.glob() Function in Python

The glob module is used for listing files inside a specific directory. The glob() function inside the glob module is used to get a list of files or subdirectories matching a specified pattern inside a specified directory. The glob.glob() function takes the pattern as an input parameter and returns a list of files and subdirectories inside the specified directory.

We can iterate through all the text files inside a specific directory using the glob.glob() function and open them with the open() function in Python. The following code example shows us how we can open all files in a directory with the glob.glob() and open() functions:

import glob import os for filename in glob.glob('files\*.txt'):  with open(os.path.join(os.getcwd(), filename), 'r') as f:  text = f.read()  print(text) 

This is the first file. This is the second file. This is the last file. 

We read the text from the three files inside the files/ directory and printed it on the terminal in the code above. We first used a for/in loop with the glob.glob() function to iterate through each file found inside the files directory. We then opened each file in read mode with the open() function and printed the text inside each file.

Maisam is a highly skilled and motivated Data Scientist. He has over 4 years of experience with Python programming language. He loves solving complex problems and sharing his results on the internet.

Related Article — Python File

Related Article — Python Directory

Copyright © 2023. All right reserved

Источник