Opening and Reading Files

Why Targeted Searches Matter

A text file may contain hundreds, thousands, or even millions of lines, while your task may require only a small subset. For example, a log file may contain many kinds of entries, but you may need only the errors. A contact list may contain many names, but you may be looking for one particular name. In these situations, processing every line in the same way is unnecessary. A targeted file search reads the file, checks each line against a condition, and processes only the lines that match.

Reading One Line at a Time

The read step moves through the file line by line. The search does not need to treat the whole file as one large piece of data. Instead, each line reaches the condition in turn. After the program makes a decision about the current line, it continues to the next line.

Filtering with String Methods

The filter is the decision point in the pattern. A condition examines the current line and determines whether it belongs in the result. Python string operations can test several kinds of matches. The in operator checks whether specific text appears anywhere in a line. The startswith method checks whether a line begins with a chosen prefix. The find method searches for a substring. These checks can be placed inside an if statement in the file-reading loop.

with open("activity.log") as file:
    for line in file:
        if "ERROR" in line:
            print(line.strip())

In this generated example, the loop reads one line at a time. The condition checks whether the text ERROR appears in the current line. Only a line that passes this condition reaches print. The strip method removes surrounding whitespace from the displayed line, which is useful because lines read from a text file may include surrounding whitespace such as a line ending.

A Complete Search Trace

Both approaches read through the file, but the targeted pattern limits the processing step. This matters when the file is large and the useful result is small. The program still examines each line to decide whether it matches, but it avoids applying the later processing action to lines that fail the condition. It also avoids loading the entire file into memory at once.

Mistakes That Change Search Results

• Forgetting to strip whitespace before processing a matching line

  The search can still identify the line, but the processed output may not have the clean form you expect.

  Fix: Strip surrounding whitespace when the processing step requires a cleaned line.

• Using a case-sensitive comparison without checking the intended capitalization

  The condition may evaluate as false even though the line represents the kind of entry you intended to find.

  Fix: Handle capitalization deliberately when choosing the search condition.

• Processing every line instead of placing the action after the condition

  The program loses the main benefit of a targeted search and performs unnecessary work.

  Fix: Put the processing action inside the matching branch so that only lines passing the filter move forward.

• Not closing the file after reading

  The source emphasizes closing files after reading as an important file-handling practice.

  Fix: Use a file-handling approach that ensures the file is closed after the search.

Practice the Pattern

The Search Pattern in Practice

Use this pattern when a text file is large or when only selected entries matter. Begin by reading the file line by line. Choose a string-based condition that expresses the search: in for text appearing anywhere, startswith for a required beginning, or find for locating a substring. Put the processing action behind the condition. This creates a single-pass search that avoids unnecessary processing and avoids loading unnecessary data into memory.

1. Read each line from the file.
2. Filter the current line with a condition based on string methods.
3. Process only the lines for which the condition is true.
4. Skip non-matching lines and continue to the next line.
5. Strip whitespace, handle case sensitivity carefully, and close the file after reading.