Manage data bottlenecks

Manage data bottlenecks

Manage data bottlenecks

Help your data suppliers to understand data requirements so they can submit data on time.

The gather360 KPI dashboard enables users to identify bottlenecks that are increasing your data preparation time and slowing down your data supply chain.

The data preparation metric includes a drill-down view of the status of your data uploads. Data uploads have three possible statuses:

  1. Uploaded
    This means a file has been uploaded but the user or supplier has not progressed to the mapping stage.

  2. Mapped
    This means a file has been uploaded and mapped, but the user or supplier has not completed the data preparation work and committed the data. This is often because the data contains errors that require resolution.

  3. Committed
    This is the final status of an upload. It means that the file has been successfully uploaded, mapped, validated and transformed and has been submitted to your data storage infrastructure.


Resolving bottlenecks in the data upload process

If you see a consistent pattern of data uploads being held up at one of the above three stages, there are a series of activities within the gather360 product that you can do to help.

If data is stuck at the upload stage:

If users or suppliers are consistently abandoning the process at the upload stage, they may be experiencing issues with data mapping. To resolve this, you can work with them to easily create a saved data mapping that is customised to match the file format that they upload. This is typically a 5 - 10 minute job.

If data is stuck at the mapping stage:

If the process is consistently being abandoned at the mapping stage, it is likely that your users or suppliers are experiencing data errors that they are struggling to resolve. This can be resolved in two ways:

  1. Adding additional error descriptions

    gather360 makes it easy to communicate with suppliers to explain data requirements in business-friendly language. When setting up your rules, users have the option to write a business-friendly description explaining each rule. These explanations will be shown in-product during the error correction process, or in a downloadable data template available within the dataset interface.

  2. Changing the error status.
    gather360 has two error configurations available - Critical and Warning. Critical errors prevent data from being submitted if data does not meet the required condition. Warnings will allow data to be submitted but will pass it to a workspace user for review before it is committed to storage.

    If your uploads are often getting stuck at the mapping stage, you can look over your rules and consider de-prioritising any low-risk critical errors to warnings.


    • Related Articles

    • Reducing data preparation time

      Reducing data preparation time How to automate data feeds and reduce your data preparation time. The gather360 KPI dashboard enables users to identify bottlenecks that are increasing your data preparation time and slowing down your data supply chain. ...
    • What is a data supplier?

      https://help.gather360.io/en/articles/5854623-what-is-a-data-supplier What is a data supplier? Learn how to collaborate with data suppliers to improve your data supply chain A data supplier is an organisation or individual that you invite to ...
    • Data validation in-line editor

       https://help.gather360.io/en/articles/5104302-data-validation-in-line-editor Data validation in-line editor Errors or warnings relating to uploaded data can now be analyzed and corrected directly within the gather360 user interface. Release 2.9 ...
    • Upload data as a data consumer

      How data consumers can upload data This flow is primarily used by data consumers who do not require a supplier to upload data on their behalf. Usually, the consumer will already have access to the data that has been previously sent via email or SFTP ...
    • Data preparation time metric

      https://help.gather360.io/en/articles/5856999-data-preparation-time-metric Data preparation time metric Learn more about the 'data preparation time' metric in your workspace KPI dashboard. The data preparation metric on your Workspace Dashboard ...