TXM - TXM - Reconciling Duplicate Lines with the Same Amount in the Same Data Set

Hi,

We are working on a Proof of Concept (POC) with the aim of implementation. 

However, one issue remains a roadblock and is hindering the adoption of the solution: the deletion of lines loaded with the same amounts, which we are unable to reconcile or isolate.

In TXM, our ERP system sends us many identical lines (following corrections by the accountants): e.g., Transaction ID 1, CPT1, Invoice: 10000 Amount: 10; Transaction ID 2, CPT1, Invoice: 10000 Amount: 10; Transaction ID 3, CPT1, Invoice: 10000 Amount: 10.

I would like to know how, within a single Data Set and from the same Data Source, to reconcile and/or isolate these lines, which represent unnecessary noise in the analyses. From my understanding, intra-Data Set reconciliations are not possible in this case. I sometimes have 2, 3, 4, 5 or even more almost identical lines that unnecessarily clutter the analyses and hinder the actual cases that need to be studied.

Do you have a solution for reconciling these lines and placing them in a reconciliation status awaiting validation? (Ideally, matching them with a reason code like "same lines," for example.)

Thanks!

BR