Forum Discussion

ssmith-nova's avatar
ssmith-nova
Contributor
3 days ago

FTP File Load Best Practice

When I pull a flat file from an SFTP server, I have been parsing that file in VB .net into a Data Table and loading it that way.  

Is this the best way to do this, or is there a way to make the Import read the file from the filesystem once it has been downloaded?  I feel like parsing a csv file using Split() is risky.

Thanks,

Scott

Data Integration
Data Sources
FileSystem
Import

1 Reply

  • tschilling's avatar
    tschilling
    Contributor
    3 days ago

    It is possible to use vb.net MemoryStream in the Renci SSH library which is useful for cases where data cannot/should not be stored in OneStream anywhere in the file system.