Forum Discussion

juergzbinden's avatar
juergzbinden
New Contributor II
21 days ago

Data Import Step - Load validated records

We are looking for a load into a financial cube. Mappings are already done in the source system. Is there a way to load records that pass the validation and write the other records to an error protocol.

The idea would be that not the whole load is rejected but only records that contain errors, those being written to an error protocol.

Many thanks for your support

2 Replies

  • rhankey's avatar
    rhankey
    Contributor III

    I think the best way to handle this would be with an TransformationEventHandler event handler that steps in upon completion BREventOperationType.Transformation.ParseAndTrans.WriteTransformedData.  Go through the transformed rows, and for those rows containing an invalid member, write it to your "error protocol" and either delete the transformed row or update the invalid transformed member to (bypass).

  • MarcusH's avatar
    MarcusH
    Valued Contributor

    As rhankey says the best way is probably adding a TransformationEventHandler script and execute it at the end of the process. I would use a method rather than WriteTransformedData. The StageSummaryTargetData method gives you all the transformed data. It takes 4 parameters: {Workflow Profile Name}{Scenario Name}{Time Name}{Filter}

    eg {MyEntity.ICO balance load}{ACTUAL}{2025M1}{IcT = '(Bypass)' Or AcT = '(Bypass)'}

    You can then fill out the rest of the filter with the other dimensions and that will give you a recordset of the rows that will not be loaded into the cube.