You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Parsing a CSV from s3 bucket data file containing an invalid row, parsing immediately stopped when the stream(data chunks ) contained an invalid row. the expected behavior is to continue parsing upon encountering an invalid-data
sample invalid data entry in the file
`"xxhTT5lwV","[email protected]","919582162103","62103"22","621","Samsung"
Parsing works with data files that do not have invalid data, But it fails with invalid data.
for handling invalid data it is not adhering to Options passed as { header: true, strictColumnHandling: true, discardUnmappedColumns: true}
first and second row has invalid data with extra quote
Parsing works with data files that do not have invalid data, But it fails with invalid data.
Expected behavior
the expected behavior is to continue parsing upon encountering invalid data, as per the documentation invalid data should handled ina data-invalid event and parsing will continue.
Screenshots
Desktop (please complete the following information):
OS: MacOS
OS Version: Sequoia 15.2
Node Version v22.12.0
fast-csv version : "^5.0.0" and ^5.0.2
Is any anything I am doing wrong or missing something in the code?
The text was updated successfully, but these errors were encountered:
ajay-psd
changed the title
[BUG] parseStream() does not work as expected when the is invalid rows
[BUG] parseStream() does not work as expected when there is invalid CSV rows
Feb 10, 2025
Describe the bug
Parsing a CSV from s3 bucket data file containing an invalid row, parsing immediately stopped when the stream(data chunks ) contained an invalid row. the expected behavior is to continue parsing upon encountering an invalid-data
sample invalid data entry in the file
`"xxhTT5lwV","[email protected]","919582162103","62103"22","621","Samsung"
Parsing works with data files that do not have invalid data, But it fails with invalid data.
for handling invalid data it is not adhering to Options passed as
{ header: true, strictColumnHandling: true, discardUnmappedColumns: true}
Parsing or Formatting?
The code snippet that I have used.
sample data in a s3 file
first and second row has invalid data with extra quote
Parsing works with data files that do not have invalid data, But it fails with invalid data.
Expected behavior
the expected behavior is to continue parsing upon encountering invalid data, as per the documentation invalid data should handled ina data-invalid event and parsing will continue.
Screenshots
Desktop (please complete the following information):
Is any anything I am doing wrong or missing something in the code?
The text was updated successfully, but these errors were encountered: