Forum Discussion

YahyaOS's avatar
YahyaOS
New Contributor II
9 months ago

Custom table limitation

Hello,

I'm creating a Custom table in OS true a business rule that retrieve data using Rest API. My source is an external Datalake from witch I want to load data to my cube. The probleme here, is when I compare data that I have in my Datalake with data that I have in my custome table I can't find the same number of Row 39200 (Datalake) vs 25000(Custom Table). Is there any default limitation in the number of rows that we can add to a custom table ? it is possible to increase it ?

Thank you in advance,

Yahya

Data Integration
  • MarcusH's avatar
    MarcusH
    Contributor III
    9 months ago

    There's no OneStream limitation on the number of rows in a custom table. We have a custom table with over 30000 rows and it works fine. I would suggest that the problem is populating the custom table not the table itself.

    • YahyaOS's avatar
      YahyaOS
      New Contributor II
      9 months ago

      Thank you for your reply, I m agreed with you, I guess the problem is with the rest Api. I tried the same request in Postman and I get the same number of Row

  • Krishna's avatar
    Krishna
    Valued Contributor
    9 months ago

    YahyaOS  - Can you try to process the statements in Batches so you dont run all in once. I would recommend using the Table Data Manager in the solution exchange to create tables. Also use SQL Bulk copy when copying the data.