Large Data in Jobs & Tasks

Data Greater Than 16MB Supported

Beginning with the 2023.2 release, Itential will now support jobs and tasks using data larger than the 16MB limit MongoDB enforces. Previously, any task that received 16MB of output would error, generally leading to an errored job. Now, not only will those tasks succeed, but the data output will be properly stored. Tasks that execute later in the job will also be able to access that data and use it as a reference task. Last, the data can be safely stored to job variables, and referenced throughout a job as a job variable.

Support Limitations

It is important to bear in mind there are some limitations to this support. Extremely large data can lead to system performance degradation that can impact efficiency and response times. Using large data in tasks, especially with concurrent jobs running, can have further performance implications as Workflow Engine has a limit on the total memory it can consume. Additionally, Itential does not support data that is greater than 256MB in size.

Display Output

Large data will not be displayed in the Operations Manager interface by default. A download button will be provided so that the data is accessible. Users will be directed to download the data and view it from their local system.

Related Reading

• MongoDB Properties
• MongoDB Query Performance