Forum Discussion

ST1's avatar
ST1
New Contributor III
3 months ago

Source Data Condition check before Import

Is there a way I can check my source records before importing data into a stage? If I am in a workflow for Import, Validate and Load, Even before the data is imported, I would like to check my source...
Data Integration
Import
ludodepaz's avatar
ludodepaz
Contributor
3 months ago

Hi, you can write a Parser Rule, it will run when you Import data. You create your rule and you call it in the Data Source like this: 

  • ST1's avatar
    ST1
    New Contributor III
    3 months ago

    Thanks! I will try it. Is there a way that we can also write error email function in parser rule or call an extender rule from parser rule? I need to send an error email if source condition does not satisfy. Would really appreciate your help

    • ludodepaz's avatar
      ludodepaz
      Contributor
      3 months ago

      Yes, you can send an email. I see 2 options

      1. if you execute the Import from a DM job and you're on V8.2 or later, you can send an email from the Data Management Sequence.
      2. There is another option, which is very slick I believe, you can log the errors in a file and then send the file by email and with a little bit of code (like add a boolean with 'has Errors'), you can send the email only if there is an error and send the details. 

      I posted a blog on how to log with a file and send the file via email, I hope it helps!
      Log like a champ with OneStream - OneStream Community (onestreamsoftware.com)