Process file in chunks instead of all-at-once #5

Open
opened 2026-10-19 04:22:45 +00:00 by martinjose · 0 comments
Owner

Currently, the entire CSV is read into memory. This could present a problem for exceedingly large files.

Instead, limit the number of rows read at a time (should be configurable) and process the file in chunks.

Currently, the entire CSV is read into memory. This could present a problem for exceedingly large files. Instead, limit the number of rows read at a time (should be configurable) and process the file in chunks.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
martinjose/modify-csv#5
No description provided.