Data Management

150 Topics

Cannot access the file because it is being used by another process
I'm trying to export data via a Data Management step. I am running into frequent errors stating: Error processing Data Management Step '[DM STEP NAME]'. Unable to create or open file '[FILE PATH]'. The process cannot access the file '[FILE PATH]' because it is being used by another process. My servers were unoccupied as no tasks were running in the background in the task activity log. I've also tried via DM sequence and selecting my own server which did not help.
bjornliow
13 hours ago Place Workflow and Data Integration
59Views
0likes
5Comments
Can ERP transactional data be loaded into OS?
Hi, my company's OS data integration with the ERP system has been set-up to load monthly TB's into OS and for transactional tables to sit outside of OS but with the ability for OS to query and drill-back to view transactions. The transactional drill-back function is limited in that a drill-down first needs to be performed to get to the detailed dimensional intersections at the lowest UD level before a drill-back to view transactions (at that precise lowest level set of dimensional intersections) can be run. It is therefore easier to use a stand-alone BI viewer outside of OS to view transactions. Am wondering - is it possible to load ERP transactional tables into OS (this may contain millions of rows spanning multiple years) and for OS to then display transactional level detail across higher-level roll-ups (e.g. viewing transactions across a cost centre parent rather than only at an individual cost centre level), or even display transactional detail in quick views, essentially making OS have similar functionality to a BI viewer?
IL
2 days ago Place Workflow and Data Integration
96Views
0likes
8Comments
Can we parameterize or set a value for the additional "options" for the Data Export step in DM?
Hello OneStream Experts, I was wondering if it is possible to set a value or retrieve a value (using XFGetValue) from user input for the "options" in the Data Export of a Data Management job while developing an Extensibility Rule. The goal is to give end users control over Data Exports without granting them access to the Application tab. Below is the code I developed to execute the Data Management sequence. I noticed there are a list of options that can be leveraged; however, I have not been able to set any values for these options. Any help or suggestions would be greatly appreciated. Thanks!
NitishKrishB
15 days ago Place Workflow and Data Integration
22Views
0likes
0Comments
Orphan members - validation error required
Hello dear community members, Background: We have had situations with month end workflow load validation errors which were fixed with UD1 mass upload. Few UD1 members ended up in Orphans, as the Parent did not exist yet in OneStream at the members mass upload step. The validation error disappeared and the workflow was complete. However, this created an Out of Balance and it was difficult to retrieve the issue. Questions/potential solutions help required: Would it be possible for the month end Workflow load Validation error to ignore Orphan members and still get an error even when we create members and end up by mistake in Orphans. Is there a way to delete Orphan members with a BR? Is there a way to stop the Metadata builder xml file to create Orphans when a parent is missing from OneStream? Thank you in advance for any idea/suggestion/tip/hint.
Solved
IrinaDragusanu
21 days ago Place Workflow and Data Integration
64Views
0likes
11Comments
Is there guidance on the setting for the number of parallel executions for Harvest Batch Loads?
When using the BRAPi.Utilities.ExecuteFileHarvestBatchParallel function in an Extender BR, does anyone have any guidance and/or opinions on the proper setting of the parallelBatchCount parameter? My understanding has always been to set it to a maximum of the number of CPUs - 1 , available for the server performing data management or batch load processing.
KurtMayer
27 days ago Place Workflow and Data Integration
118Views
0likes
2Comments
Automating Data Access from OneStream to Snowflake: Exporting Financial and Master Data
How to configure the OneStream system to push the transaction and master data (dimensions) to Snowflake without manual intervention? I need step-by-step Info how to pull data from Snowflake into OneStream.
Sibi_S
2 months ago Place Workflow and Data Integration
402Views
0likes
4Comments
how do I check if a period is locked or unlocked in vb.net
I have a requirement to load to the most recent unlocked period. Using VB or C#, how do I check if a period is locked or unlocked? Thanks, Scott
Solved
ssmith-nova
2 months ago Place Workflow and Data Integration
81Views
0likes
1Comment
Scheduling an extract of metadata
I'm being asked to schedule an extract of the OneStream metadata. I'm under the impression that this cannot be done using the Task Scheduler since an extract of metadata is not an option in Data Management. Is this an accurate statement? If this can be schedule, how so? Thanks!
Solved
ChrisFeller
2 months ago Place Workflow and Data Integration
2KViews
0likes
7Comments
Files manipulation on SFTP Location
I need to move some files around the various folders on our SFTP server and I am trying to do it via the Extender BR. Basically I need to move the files from the staging folder into various other folders based on the file names. The rule below compiles successfully. When executed, I get the exception on the second pass ("Chase" related) but no files are being moved anywhere. I am stumped at the moment and would appreciate any suggestions. Thank you in advance. Yan Public Class MainClass Public Function Main(ByVal si As SessionInfo, ByVal globals As BRGlobals, ByVal api As Object, ByVal args As ExtenderArgs) As Object Try 'Set up SFTP connection session options Dim sessionOptions As New sessionOptions With sessionOptions .Protocol = Protocol.Sftp .HostName = "xxxxxxxxxx.xxxxx.com" .UserName = "XXXXXXX" .Password = "xxxXXxxxXXXXXx" .SshHostKeyFingerprint = "ssh-rsaxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxpNuL5H42WiDJY=" End With 'Use Session Using session As New Session 'Connect session.Open(sessionOptions) Dim transferOptions As New TransferOptions transferOptions.TransferMode = TransferMode.Binary Dim baiDirLocation As String = session.HomePath & "/test/TXM/BAI/" Dim remoteFiles As RemoteDirectoryInfo = session.ListDirectory(baiDirLocation) Dim results As TransferOperationResult Dim fileNumber As Integer = 0 For Each x As RemoteFileInfo In remoteFiles.Files Dim newName As String = Nothing If x.Name.Contains("Mizuho") Then results = session.PutFiles(baiDirLocation & x.Name, baiDirLocation & "Mizuho/" & x.Name, False, TransferOptions) If Not results.IsSuccess Then Throw New Exception("The file transfer from SFTP to OneStream harvest failed 1.") End If ElseIf x.Name.Contains("Chase") Then results = session.PutFiles(baiDirLocation & x.Name, baiDirLocation & "Chase/" & x.Name, False, TransferOptions) If Not results.IsSuccess Then Throw New Exception("The file transfer from SFTP to OneStream harvest failed 2.") End If 'Nothing End If 'Move or Remove Files or Move SFTP files to archive 'Session.RemoveFiles(glDirLocation & "S4iiisubdata_US50.txt") fileNumber += 1 Next 'Next Ends the Loop End Using 'Setup email distribution list When files are present Dim distributionList As New List(Of String) distributionList.Add("yyy.yyyyyyy@yyyyy.com,xxx.xxxxxxx@xxxxx.com") 'Calls email Sub Routine 'EmailNotification(batchinfo, si, distributionList) Return Nothing Catch ex As Exception Throw ErrorHandler.LogWrite(si, New XFException(si, ex)) End Try End Function End Class
Solved
YanSavinsky
2 months ago Place Workflow and Data Integration
46Views
0likes
4Comments
Reference a parameter in a different workspace than default
I am executing a Copy Data Management step which references a literal parameter (NOT in Default workspace) to get the scenario value. However, I am receiving an "Invalid Parameter" error when trying to use the parameter even though I confirmed the parameter is named correctly and has a value. However, when I created the same parameter in the Default workspace, the Data Management step executed successfully. In a Data Management step, is there a way to denote which workspace the parameter should be coming from? I tried something like: workspace_name.|!Scenario_parameter!| but no luck. Is there any documentation on this?
Solved
ethanmgomes
2 months ago Place Workflow and Data Integration
1.8KViews
0likes
8Comments