Maximum payload size for MongoDB
Beginning with the 2023.2 release, Itential Platform supports jobs and tasks using data larger than the 16MB limit enforced by MongoDB. Previously, any task that received 16MB of output would error, typically causing the job to fail. Tasks that previously errored will now succeed, and their output will be properly stored. Tasks that execute later in the job can access that data as a reference task output, and the data can be stored and referenced as a job variable throughout the job.
Limitations
This limitation applies to the modified payload, which may be larger than the data initially passed in. For example, a 240MB payload may grow as Itential Platform performs the necessary modifications to store it in GridFS. In that case, the modified payload may exceed 256MB, causing the task to error.
Keep the following limitations in mind:
- Extremely large data can cause system performance degradation, impacting efficiency and response times.
- Using large data in tasks — especially with concurrent jobs running — can further affect performance, as Workflow Engine has a limit on total memory consumption.
- Itential Platform does not support data greater than 256MB in size.
Display output
Large data is not displayed in the Operations Manager interface by default. A download button is provided so the data remains accessible. You are directed to download the data and view it from your local system.
