Scenario security to prevent data load for Actuals via XFSet

Expanding this question to QuickViews and the ability to submit data from excel.  In our example we have Import, Form (Cash Flow Walk,...) and ADJ (Journals) channels in all our Actual WF's.  No Forms allow updates that impact Financial information and JE already have control on them.  We do have some advanced Excel users that could create QuickViews and submit data directly to Actuals.  Is there a way to prevent this.  To us this is an Audit Issue that we feel our Auditors are going to get on us about.