Processing Structured Text Files

A Line Has More Than You See

A line read from a text file usually contains an invisible newline character at its end. That character is part of the string even though it is not visible on the screen. If you pass the line directly to print(), the existing newline and print()'s automatic newline work together, creating an empty line between displayed lines.

Prefix Checks with startswith()

line_a = "From: sender"
line_b = "Message received from: sender"

print(line_a.startswith("From:"))
print(line_b.startswith("From:"))

True
False

This distinction matters when a file uses prefixes to identify different kinds of lines. For example, a structured text file might use From:, Subject:, or Date: at the beginning of lines. A conditional using startswith() can select only the kind of line you need instead of matching the same text when it appears in the middle or at the end.

Removing Trailing Characters

line = "Subject: Report   \n"
clean_line = line.rstrip()

print(clean_line)

The Filtering Pipeline

The useful workflow combines both methods. For each line, first remove trailing whitespace with rstrip(). Then check the cleaned line with startswith(). If the Boolean result is True, display the line. If it is False, skip it. Calling rstrip() first creates a clean value for both the test and the output, even though a newline at the end would not change a prefix check at the beginning.

for line in file: clean_line = line.rstrip() if clean_line.startswith("From:"): print(clean_line)

From: sender@example.com
From: archive@example.com

In this generated example, lines beginning with Subject: or other text are not displayed. The selected From: lines appear with single spacing because rstrip() removed their stored newline before print() added its own.

Structured Text in Practice

Structured text files often give different meanings to lines based on their prefixes. Email files can use prefixes such as From:, Subject:, To:, and Date:. Log files can use ERROR:, WARNING:, or INFO: to mark severity levels. The same processing pattern works in both cases: clean each line, test its prefix, and display or process only the lines that match.

Mistakes to Avoid

• Treating startswith() as a general search method

  The target text is not at the beginning of the string, so startswith() returns False.

  Fix: Use startswith() when the prefix position matters. It checks only the beginning of the string.

• Printing the original file line directly

  The file line already contains a newline, and print() adds another newline.

  Fix: Call line.rstrip() before printing.

• Using rstrip() after the line has already been printed

  The extra spacing has already occurred by the time the cleaned value is created.

  Fix: Clean the line first, then pass the cleaned value to startswith() and print().

• Checking one value but displaying a different uncleaned value

  The condition uses the cleaned line, but the output still contains the original trailing newline.

  Fix: Print clean_line so the value tested and displayed has the same cleaned form.

Practice the Pattern

for line in file:
    clean_line = line.rstrip()
    if clean_line.startswith("Subject:"):
        print(clean_line)

Key Takeaways

1. startswith() checks only whether a string begins with a specified prefix and returns True or False.
2. A line read from a file includes a trailing newline, while print() adds another newline, which can create double spacing.
3. rstrip() removes trailing whitespace and newline characters from the end of a string.
4. A reliable filtering pattern is to call rstrip(), test the result with startswith(), and print the cleaned line when the test is True.
5. Prefix-based filtering is useful for structured text such as email-style files and log files.