Skip to content

Modified preprocess.py to remove the strict file count mismatch check.#1986

Open
niveditasing wants to merge 4 commits intodatacommonsorg:masterfrom
niveditasing:code_fix_us_annual_pop
Open

Modified preprocess.py to remove the strict file count mismatch check.#1986
niveditasing wants to merge 4 commits intodatacommonsorg:masterfrom
niveditasing:code_fix_us_annual_pop

Conversation

@niveditasing
Copy link
Copy Markdown
Contributor

@niveditasing niveditasing commented Apr 29, 2026

Modified preprocess.py to remove the strict file count mismatch check.

differ is clean & has no deletions

PR checklist : https://docs.google.com/spreadsheets/d/1BzweR9Sj58j0H2_BweGTmfE4Z1lrjPZL8u1FS0kzCeg/edit?pli=1&gid=0#gid=0

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request modifies the file processing logic in the US Census PEP preprocessing script to handle partial successes by logging a warning instead of failing when the number of processed files is less than expected. It also updates the error handling when no files are processed. A review comment suggests reverting the change from logging.fatal to logging.error to ensure the script exits with a non-zero status upon failure, preventing silent failures in automated environments.

Comment thread scripts/us_census/pep/annual_population/preprocess.py Outdated
@niveditasing niveditasing requested a review from saanikaaa April 30, 2026 05:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant