Import files from FTP Connection

[Ricardo_Mil]

Hello,

I'am newly at OneStream and now I have a requirement from a client:

- They want to import, automatically, files that will be data source of a Workflow Profile = import;

1. Those files are on FTP (FTP connection), that means that I need to add on the current application server, a connector type = gateway, right?  Also, what I need to define on the connection string?

2. Then I need to create a BR for the connector;

3. Since the files are "delimited files", so on the Data Sources menu, I need to create a new Data source - delimited file and map the columns to the correspondent dimensions that exists in OneStream right? Also, on the connector setting option, I need to assign the delimited file to the BR connector that I created previously, right?  

 4. On the Workflow Profile, I will assign it to the new delimited file.

Are these the correct steps?

Thank you all.

Ricardo

[JoakimK · Accepted solution]

Hello Ricardo,

Unfortunately you cannot setup a SFTP in that manner, by leveraging the connectors.

1. Since you are using flatfiles, the import type (and datasource) will first and foremost be setup as a Flat File (not a connector)

2. This means the Workflow will now be enabled to manually import files. Now you need to setup a process to automate this from the SFTP, and for this you would need a Business Rule that will contain all the connection details as well as file copy process from the SFTP.

3. Once that Business Rule is in place, you can setup a DataManagement job to schedule this for automation, or you can setup a dashboard with a button to the same DataManagement job, that will allow you to attach the dashboard to the Workflow and have the user themselves kick off the file retrieval process.

The overall process described here is very high level, and there are many further factors to consider, such as how to identify each file for each workflow, do you need to move the files or just copy, do you need to archive the files etc.

If you are working with an implementation partner, they should be able to assist you with all this, but if you want help from us directly you can reach out to our support team who will forward the request to our Advanced Application Solutions team who can then discuss with you how we could assist.

Joakim

[Ricardo_Mil]

Hi Joakim,

Thanks for your reply!

Best regards,

Ricardo

[vmanojrc30]

Hi Joakimk

Thanks for your response. I am working on a similar requirement and I have a follow-up question to clarify on your suggestion below.In the below, where should the business rule copy the file to?Is there a system path and folder where we can place the file and configure the workflow to pick the source file from there?

2. This means the Workflow will now be enabled to manually import files. Now you need to setup a process to automate this from the SFTP, and for this you would need a Business Rule that will contain all the connection details as well as file copy process from the SFTP.

Another option I thought through was to request IT team to place the flat files under OS file share folder Fileshare/Applications/<OS Application>/Incoming/<Workflow Profile>/<Import Profile>/<Filename.csv>.

However I dont know if there is way to reference this file path in the Import Workflow profile so when I schedule the  Workflow to run automatically , OS know where to pick the file from.Any information or suggestions you have would be helpful.

[DanielWillis]

I'd recommend checking out the new Smart Integration Connector to see if it's a fit. I think there's a webcast about it next week if it wasn't this week and there is also a training course already out on the training platform which goes into a lot of detail. 

[vmanojrc30]

Hi Daniel

I believe SIC is applicable only for cloud OS applications. We are using On premise OS apps.

Thanks

Manoj