OneStream Power BI Connector - Optimal Performance
Hi All,
Has anyone used the OneStream Power BI Connector to pull millions of records and found the fastest way to do it?
I’ve been asked to use the .TreeDescendantsInclusive member expansion in the Get Cube Data function for a few dimension members, but this is making my query run very slowly. I was previously just using the .Base member expansion and could pull about 5 million rows in 20 minutes. To avoid the 2 million row limit, I created an M Query that loops through specific dimensions and splits the calls into smaller queries. This included several historical periods, and doing an incremental refresh for 1–2 periods didn’t take long.
Here’s a screenshot of part of my new query using .TreeDescendantsInclusive.
My issues now are:
- The queries eventually fail because one of them hits the 2 million row limit, because I cannot easily loop through some of the new expanded dimensions
- It takes an extremely long time to query and load data into their Power BI data model as I am now pulling an estimated 30 - 40 million rows at once
Is there a way to optimize what I have so that it doesn't take a long time to query data, or is this just how the connector works?
Thanks!