Product: TIBCO Spotfire®
Unable to export data to library while using TIBCO Spotfire Automation Services.
While running a TIBCO Spotfire Automation Services job, "Export Data To Library" task might fail with the error "Failed to export data table". The error trace in the Automation Services instance log would be as below.
ERROR;2020-04-11T1:09:49,197-06:00;2020-01-11 17:07:39,197;e773b0b7-64bc-4100-8f3c-12da2bf1e815;1315496816YGpT;39;automationservices@SPOTFIRESYSTEM;Spotfire.Dxp.Automation.Tasks.Tasks.ExportDataToLibrary; "Failed to export data table 'xxxxxx' (92fb5491-c433-4b34-9346-c2beb9fbdac3) from analysis '/xxx/xxxxx/xxxxxxxx' as SBDF to library path '/xxx/xxxx/xxxxx'. Reason: Spotfire.Dxp.Framework.Library.LibraryException: An Internal Server Error has occurred. ---> Spotfire.Dxp.Services.Library.LibraryServiceException: An Internal Server Error has occurred. at Spotfire.Dxp.Services.WebServiceBase`1.InvokeService[T](ServiceMethod`1 serviceMethod, ExceptionFactoryMethod exceptionFactoryMethod) at Spotfire.Dxp.Services.Library.LibraryService.Save(LibraryItem item, String attachmentId, Fields fields) at Spotfire.Dxp.Framework.Library.InternalLibraryManager.<>c__DisplayClass77_1.<Save>b__2() at Spotfire.Dxp.Framework.Library.InternalLibraryManager.StartServiceRequest(String operation, RequestStartExecuter executer) --- End of inner exception stack trace --- at Spotfire.Dxp.Framework.Library.InternalLibraryManager.StartServiceRequest(String operation, RequestStartExecuter executer) at Spotfire.Dxp.Framework.ApplicationModel.Progress.ExecuteSubtask(String title, ProgressOperation operation) at Spotfire.Dxp.Framework.Library.InternalLibraryManager.Save(LibraryEntry entry, Action`1 streamWriter, Fields fields, Boolean embedInSubtaskProgress) at Spotfire.Dxp.Application.Export.ExportHandler.ExportDataTableAsSbdfToLibrary(DataTable table, String dataSelectionName, String libraryPath, String libraryDescription, String libraryKeywords, AnalysisApplication application) at Spotfire.Dxp.Automation.Tasks.Tasks.ExportDataToLibrary.ExecuteCore(TaskExecutionContext context)"
This error can be seen if Spotfire is using a Microsoft SQL Server(MS SQL) based Spotfire database and if the size of the SBDF file that is being saved in the library exceeds 2 GB. This is because data is stored in Microsoft SQL Server as Varbinary and the maximum size of a varbinary(max) column is 2GB. This is a Microsoft SQL Server limitation.
Note: Within the dxp file, the same amount of data would have been stored. This is because the dxp file has all the data in compressed format so the dxp file size will be smaller, whereas, in SBDF file, the data will not be compressed and the size of the SBDF file will be much more than that of the dxp file with the same data. There is no solution to fix this issue if using Microsoft SQL Server as the Spotfire Database, as this is a limitation on the Microsoft SQL Server side.
KB: 000019945 Unable to save an Analysis File which is more than 2 GB