---
title: Best Practices for Mass Data Uploads in Proqio
description: Learn best practices for mass data uploads in Proqio to avoid processing delays, ensure timely live data handling, and optimize system performance.
---
[Skip to content](https://help.proqio.com/best-practices-for-mass-data-uploads-in-proqio#main-content)
[](https://help.proqio.com/?hsLang=en)
Open main navigation
Close main navigation
How can we help you?
- There are no suggestions because the search field is empty.
1. [Knowledge base](https://help.proqio.com/?hsLang=en)
2. [Managing Your Data](https://help.proqio.com/managing-your-data?hsLang=en)
# Best Practices for Mass Data Uploads in Proqio
Large data imports can significantly impact system performance if they are uploaded in bulk. When millions of records—each containing multiple variables—are sent at the same time, Proqio must process them sequentially for each instrument. This creates a long processing queue that delays the handling of live instrument data. As a result, real-time updates may be slowed or temporarily blocked.
To ensure smooth system performance, especially for projects that require timely processing of live measurements, consider the following best practices detailed in this article.
### Summary
Mass data uploads can disrupt Proqio’s processing pipeline when sent as a single large batch. The most effective way to prevent delays is to:
1. **Upload data continuously throughout the day (best option).**
2. Schedule large uploads outside times when live data is required.
3. Aggregate or reduce dataset size before uploading.
Following these guidelines ensures reliable platform performance and timely processing of both historical and live instrument data.
---
### 1. Upload Data Continuously Instead of in Bulk (Recommended)
The ideal approach is to send records as they are generated, rather than accumulating them and sending them all at once.
Benefits:
- Prevents large processing spikes.
- Ensures live instrument data continues to be processed without delays.
- Reduces strain on the processing queue by distributing load throughout the day.
If your workflow allows for it, this is the most effective and scalable solution.
### 2. If Continuous Upload Is Not Possible, Schedule Bulk Uploads Outside Peak Times
If you must upload large batches, plan them for times when:
- No live data is being transmitted, or
- The project does not require immediate instrument processing.
This avoids competing with time-critical live data and helps maintain platform responsiveness for active monitoring tasks.
### 3. Aggregate or Downsample Data Before Sending
When neither continuous uploads nor off-peak scheduling is viable, consider reducing the size of the dataset prior to upload.
Possible approaches:
- Aggregate multiple readings into summary values.
- Downsample at intervals where full resolution is not needed.
- Compress high-frequency data into grouped batches.
This reduces the total data volume and minimizes ingestion load.
- [Getting started](https://help.proqio.com/getting-started?hsLang=en#main-content)
- [Project details](https://help.proqio.com/getting-started?hsLang=en#project-details)
- [Teams and members](https://help.proqio.com/getting-started?hsLang=en#teams-and-members)
- [Account](https://help.proqio.com/getting-started?hsLang=en#account)
- [Configure Your Instruments](https://help.proqio.com/getting-started?hsLang=en#configure-your-instruments)
- [Notifications](https://help.proqio.com/getting-started?hsLang=en#notifications)
- [Connectivity methods](https://help.proqio.com/getting-started?hsLang=en#connectivity-methods)
- [Alerts](https://help.proqio.com/getting-started?hsLang=en#alerts)
- [Map](https://help.proqio.com/map?hsLang=en#main-content)
- [Tools](https://help.proqio.com/map?hsLang=en#tools)
- [Analysis](https://help.proqio.com/map?hsLang=en#analysis)
- [Monitoring](https://help.proqio.com/monitoring?hsLang=en#main-content)
- [Instruments](https://help.proqio.com/monitoring?hsLang=en#instruments)
- [Dashboard Creation & Configuration](https://help.proqio.com/dashboard-creation-configuration?hsLang=en)
- [Report Creation](https://help.proqio.com/report-creation?hsLang=en)
- [New Feature Releases](https://help.proqio.com/new-feature-releases?hsLang=en)
- [Project Hierarchy](https://help.proqio.com/project-hierarchy?hsLang=en)
- [Analyse and Interpret your Data](https://help.proqio.com/analyse-and-interpret-your-data?hsLang=en)
- [Learn How to Navigate Proqio](https://help.proqio.com/learn-how-to-navigate-proqio?hsLang=en)
- [Configure Your Map View](https://help.proqio.com/configure-your-map-view?hsLang=en)
- [How to Add a Real Time Picture on Map](https://help.proqio.com/how-to-add-a-real-time-picture-on-map?hsLang=en)
- [Managing Your Data](https://help.proqio.com/managing-your-data?hsLang=en)
- [Uploading Records Manually](https://help.proqio.com/uploading-records-manually?hsLang=en#main-content)
- [Steps for uploading instrument data records manually](https://help.proqio.com/uploading-records-manually?hsLang=en#steps-for-uploading-instrument-data-records-manually)
- [ADA](https://help.proqio.com/ada?hsLang=en)
- [Digital Twin](https://help.proqio.com/digital-twin?hsLang=en)
- [Lines and Textures](https://help.proqio.com/lines-and-textures?hsLang=en)
[](http://www.proqio.com?hsLang=en)
Copyright © 2026, Proqio