DataBolt

DataBolt stands as an automated research data teleport system meticulously crafted by Intersect. It serves as an agile and resilient solution for research projects, ensuring dependable data acquisition. Our adaptable design pattern and configurable software seamlessly integrate across diverse platforms. The DataBolt Collection and Delivery components are currently containerised, enabling smooth operation within an organisation’s centralised, distributed, and edge infrastructures, facilitating IoT-scale data collection.

DataBolt offers three access-controlled dashboards, strategically positioned to provide visibility at key data transfer points. One resides at the data collection (CA) point, another at the data reception (DA) end, and a comprehensive overview at the DataBolt Director level, offering a high-level organisational perspective. Stakeholders can access the dashboard that best suits their needs.

With DataBolt Agents, installation is flexible—deploy as many as necessary, as many times as needed. Once installed, remote management capabilities streamline operations, allowing for effortless activation, deactivation, and configuration updates. This functionality significantly reduces the burden on IT teams, especially in managing agents deployed across remote locations.

• Automated data capture.
• Seamless, secure and reliable data transfer.
• Access to scalable, active and archival data storage.
• Cross-platform Collection and Delivery Agents that can run in any container-compatible environment.
• Move large data sets in chunks to efficiently utilise network bandwidth.
• Data validation at destination, and creation of manifests.
• Multiple use cases via configuration.
• Source cleansing to manage remote data sizes.
• Data integrity processes like two-phase commit to ensure data integrity.
• Metadata available at the origin stays with the data.
• Researcher-friendly dashboard to view the live data transfer.
• Role-based access for monitoring, and managing data transfers.
• Customised delivery options like invoking a process or webhook post delivery of data
• Optional integration with IDEA – A data management platform for any type of data, and unlimited data workflows

DataBolt Platform Topology:

Who is DataBolt for?

DataBolt is a platform used by researchers looking to capture large quantities of data, university IT services, data managers, distributed research teams and anyone interested in implementing a robust data capture system from instruments and/or remote sensors.

DATABOLT FLYER 

Streamlined Data Transfer

In the realm of modern research, data acquisition from on and off-campus instruments is ubiquitous. However, the manual, error-prone, and time-consuming nature of data movement to analysis environments poses significant challenges. DataBolt addresses this issue comprehensively, offering a modular data transfer solution that dramatically reduces administrative overhead.

Automated, Fault-Tolerant, and Scalable

DataBolt is the modern apex of automation, fault tolerance, configurability, and scalability in research data transfer. It minimises manual intervention from data collection to transfer, maximising throughput while ensuring file and collection integrity at every stage. Its scalable architecture enables seamless adaptation to varying data collection needs, maintaining reliability and performance.

Strategic Agent Placement

DataBolt’s Collection Agents (CA) can strategically reside closer to data sources, mitigating acquisition risks, while Destination Agents (DA) can be positioned either on-site or remotely. These agents, connected securely through the Internet, enhance data movement efficiency and security.

For Researchers

Effortless Data Collection

Researchers gain a streamlined approach to collecting data from instruments, virtual machines, or personal computers. They exercise granular control over specifying files or folders for transfer to various destinations, establishing transfer frequencies based on time intervals or specific conditions.

Tailored Configurations

DataBolt’s high configurability and modularised structure provide researchers with the freedom to craft bespoke collection or delivery mechanisms. This adaptability ensures a perfect fit for diverse research requirements, enabling optimised data management solutions.

For IT Personnel

Simplified Deployment and Management

DataBolt’s Docker container-based architecture supports multiple operating systems, easing deployment complexities. With Intersect’s support, IT personnel efficiently deploy and configure CAs and DAs. The remote accessibility of the DataBolt Director simplifies ongoing management tasks, eliminating the need for physical presence at locations post-deployment.

Secure and Adaptable Infrastructure

DataBolt operates seamlessly within isolated environments, be it within lab networks or Virtual Private Networks, ensuring secure data transfer. Its exclusive use of HTTPS communication with the DataBolt Director enhances security without necessitating the opening of specialised ports, reducing operational complexities.

Streamlined Operations

DataBolt’s reliance on HTTPS for communication simplifies network configurations for IT personnel, negating the need for managing dedicated ports, or installing specific software other than Docker. This streamlined approach enhances operational efficiency and security measures.

Fees

The Establishment fee for a DataBolt Instrument programme is $10,000 (Member) or $15,000 (Non-Member)

The establishment fee includes:

• 2 days onsite for the first instrument integration; (Travel and Accommodation charges, ex-Sydney to be reimbursed at cost)
• Training a suitable skilled local resource in deployment and support;
• DataBolt Network and Data design;
• Using Standard DataBolt collector and deliverer modules.

New Collector/Deliverer module indicative pricing

• Standard module extensions typically $2,000 (member) or $3,000 (non-member)
• Custom rules module  P.O.A.
• Custom Metadata harvesting and delivery $5,000 to $10,000 depending on complexity

Instruments

Instrument licenses include up to 3 agents and 3 origins or destinations per Agent, and are licensed according to the following table.