Forum Discussion

ssmith-nova's avatar
ssmith-nova
Contributor
2 months ago
Solved

FTP File Load Best Practice

When I pull a flat file from an SFTP server, I have been parsing that file in VB .net into a Data Table and loading it that way.  

Is this the best way to do this, or is there a way to make the Import read the file from the filesystem once it has been downloaded?  I feel like parsing a csv file using Split() is risky.

Thanks,

Scott

Data Integration
Data Sources
FileSystem
Import
  • ssmith-nova's avatar
    ssmith-nova
    31 days ago

    tschilling​ thank you for the response.  What I am looking for is how best to process the file.  I was overthinking it. I just land the file formatted correctly in the Batch Harvest folder and run it that way.  

    Thanks

2 Replies

  • tschilling's avatar
    tschilling
    Contributor
    2 months ago

    It is possible to use vb.net MemoryStream in the Renci SSH library which is useful for cases where data cannot/should not be stored in OneStream anywhere in the file system.  

  • ssmith-nova's avatar
    ssmith-nova
    Contributor
    31 days ago

    tschilling​ thank you for the response.  What I am looking for is how best to process the file.  I was overthinking it. I just land the file formatted correctly in the Batch Harvest folder and run it that way.  

    Thanks