Forum Discussion

HeatherB_eCap's avatar
HeatherB_eCap
Contributor III
3 years ago

Two Double Quotes in Delimited Data Sources

Hey everyone. We are implementing a use case for a client that requires import of transactional data found within a csv file. The data is comma delimited, and enclosed in quotes. For example, if the ...
Data Sources
Krishna's avatar
Krishna
Valued Contributor
3 years ago

Hope this Helps

Dim sampleStr As String = "2"" pipe"
brapi.ErrorLog.LogMessage(si,sampleStr.Substring(0,1) & sampleStr.Substring(2))

 

Output

 

 

 

  • HeatherB_eCap's avatar
    HeatherB_eCap
    Contributor III
    3 years ago

    Hi Krishna, I ended up writing a RegEx statement within the workflow automation rule I wrote to read each line in the file, find and replace the offending string, and write the dataset to a new file. It does not seem possible to handle this using a complex expression or transformation rule within the Data Source definition, because the existence of the two double quotes corrupts the processing of the delimiters in the file and causes OneStream to import data into incorrect columns. I was hoping there was a way to handle this more natively within the Data Source definition itself, as the existence of two quotes is an accepted csv file format and technically should be handled correctly by the platform.

    I do appreciate your comment, though. 

    Thanks

    Heather