The OneStream Community is temporarily frozen until June 29th due to the ongoing maintenance. Please read the blog post here to learn more.

Forum Discussion

Mustafa_A's avatar
Mustafa_A
Contributor II
4 years ago

Clear data from Workflow import

Hey everyone -    How do I clear data from these workflow manual imports automatically? Right now, I've been going through each month one by one. Wondering if there is a BR that can run them all t...
Data Integration
Import
ckattookaran's avatar
ckattookaran
Valued Contributor
4 years ago

You can create an Extender rule that mimics a load using the following.

Dim impProcessInfo As LoadTransformProcessInfo = BRApi.Import.Process.ExecuteParseAndTransform(si, wfCurrentClusterPk, "filename or dm name", Nothing, TransformLoadMethodTypes.Replace, SourceDataOriginTypes.FromFileUpload, True)

  You can change the loadmethodtypes to do replaces. I've not tried that with a blank file though.

  • Mustafa_A's avatar
    Mustafa_A
    Contributor II
    4 years ago

    Hi ckattookaran 

    I'm not intending to load a blank file. I want the WF to "Clear" data by itself, and run the validation-load steps period by period. 

    Last night,  I figured out a different solution and it works. It's mainly defining the workflow (using as WFUnitClusterPk) and using brapi.import.process to execute the various steps (Clear Data, Retransform, Validate, Load).

     

    • ckattookaran's avatar
      ckattookaran
      Valued Contributor
      4 years ago

      Your question was how can I clear the data from workflow profiles, not how can I automate the load process!

      Are you saying that there is a method in brapi.import.process to clear the data alone?

      • Mustafa_A's avatar
        Mustafa_A
        Contributor II
        4 years ago

        Oh, apologies if I wasn't clear. 

        Yes, there is...

         

    • kbon's avatar
      kbon
      New Contributor
      4 years ago

      Hello,

       

      can you please share with me the code used to automate the workflow (import, validate, load) ? thank you 

      am trying to use the executeparseandtransform function but it seems it doesnt work with me 

       

      can you please help ? thank you .

      • ckattookaran's avatar
        ckattookaran
        Valued Contributor
        4 years ago

        You do have the option of using harvester. However, I don't like to use that process since it is not readable by an outsider. You can use the following to mimic what the workflow is doing.

        ExecuteParseAndTransform

        ValidateTransformation

        ValidateIntersections

        LoadCube

        ExecuteProcessCube

        What error are you getting during the executeparse?

    • ASides's avatar
      ASides
      New Contributor III
      3 years ago

      Hi Mustafa,

       

      I am looking to perform something similar. Is the goal of this to entirely clear cube data related to this workflow profile/load? If you are clearing the Stage data, then what is being retransformed/validated/loaded? My understanding is that those steps would fail unless staged data exists.