Data Upload Procedures

This guide covers the various methods and procedures for uploading data to XNAT.

Overview

XNAT provides multiple ways to upload research data, each suited for different use cases and data types.

Note

Prearchive vs. Archive: In XNAT, data typically lands in a temporary holding area called the Prearchive first. Here, you can review, label, and clean up data before committing it to the permanent Archive.

  • Prearchive: Staging area. Data can be edited or deleted.

  • Archive: Permanent storage. Data is indexed and protected.

For more details about the Prearchive, see Understanding the Prearchive. For official XNAT documentation, refer to the Official XNAT Documentation on Data Archiving.

Important Considerations

Before uploading, please be aware of the following safety guidelines:

Warning

Overwriting and Merging Data

Uploading data to an existing project or session can overwrite existing files or merge new data into an existing session.

  • Overwrite: If you upload a file with the same name as an existing file, the old file may be replaced.

  • Merge: If you upload new scans to an existing session, they will be added to that session.

Always check your project’s upload settings and ensure you are uploading to the correct Subject and Session labels.

Caution

Permissions

Your ability to upload, archive, or edit data depends on your user role and project permissions. If you encounter errors, ensure you have “Member” or “Owner” access to the destination project.

Warning

Data Anonymization

Data from MRI scanners is anonymized at the acquisition step. When uploading data manually (via Desktop Client or Compressed Uploader), ensure that your data is properly anonymized before upload. All personally identifiable information (PII) and protected health information (PHI) must be removed or de-identified according to your project’s requirements.

Upload Methods

There are three primary ways to upload data to this XNAT instance.

1. Uploading using Scripts (DICOM Receiver)

This method is the standard way for MRI scanners and automated scripts (like storescu or C-STORE clients) to push data directly to XNAT.

Connection Details

Configure your scanner or sender script with the following parameters:

  • Remote AE Title: xnatad

  • Remote IP: 10.230.12.52

  • Remote Port: 8104

How it works

Data sent to this receiver is routed to the XNAT Prearchive. From the Prearchive, you can review and archive the sessions.

Study Description Routing

The DICOM Study Description field is used to automatically route data during the archiving process. The routing string must follow this format:

xnat://project_id/subject_label/session_label

Examples: * xnat://MyProject/SUBJECT001/SESSION001 * xnat://ResearchStudy/P001/Baseline

If the Study Description field contains no routing information or conflicting information, the data will remain in the Prearchive until it is manually routed by an administrator or project member with appropriate permissions.

Note

Manual Routing Required

If your scanner or DICOM sender cannot populate the Study Description field with the routing string, you will need to manually route sessions from the Prearchive after they are received. Contact the XNAT NYUAD administrator if you need assistance with automated routing setup.

2. XNAT Desktop Client

The XNAT Desktop Client is a standalone application that provides a robust way to upload large batches of data or complex folder structures. It is recommended for users who prefer a graphical interface with resumable uploads.

Installation Ensure you have the XNAT Desktop Client installed. (See Install XNAT Desktop Client if available, or check the Official XNAT Desktop Client Wiki).

Step-by-Step Upload Guide

You can start an upload in two ways:

Option 1: Launch from XNAT Web Interface

Navigate to the project or subject page where you want to upload data. Click Upload Images from the Actions menu. This will automatically open the Desktop Client and log you in using your current web session credentials.

Launching Desktop Client from XNAT web interface

Clicking “Upload Images” from the Actions menu automatically opens and logs into the Desktop Client

Option 2: Launch Desktop Client Directly

  1. Login: Open the Desktop Client and log in with your XNAT credentials.

  2. Start Upload: Click the Upload Images button on the main dashboard.

  3. Select Project: Choose the destination project for your upload. The Desktop Client will retrieve project-specific settings that may affect your upload workflow.

    XNAT Desktop Client Project and Data Selection Screen

    Project and Data Selection screen showing project list, folder selection, and project settings panel

  4. Select Files: Drag and drop your DICOM folders or use the file browser to select them. The client will scan the files to identify image sessions. The selected folder must contain one or more sets of uncompressed DICOM image files, which can be in a flat directory structure or in subfolders.

Single Session Upload Workflow

After selecting your project and data folder, you will proceed to the “Confirm Details” step where you can configure the following options:

  • Subject Selection: Choose an existing subject from your project using the dropdown menu, or click “Create new subject” if your project allows subject creation.

  • Subject Label: Ensure this matches your project’s naming convention.

  • Session Label: The client will auto-generate a session label based on the subject label and other variables. You can override this label if needed. Allowed characters are alphanumeric, dash (-), and underscore (_). If you specify a session label that matches an existing session, XNAT will attempt to merge selected scans into the existing session.

  • Scan Selection: You can select which scan series to include in the upload using the checkboxes in the scans table. The table displays Series Number, Series Description, Modality, File Count, and Size for each scan. By default, all scans are selected. Unchecked scans will not be uploaded.

    XNAT Desktop Client Confirm Details Screen

    Confirm Details screen showing project, subject, and session label fields, along with the scan selection table

Bulk Upload Workflow

If you have multiple image sessions queued, you will be taken to the Bulk Upload Screen. Bulk upload may be restricted for some projects. When available, you can:

  • Apply standard subject and session labeling patterns

  • Upload multiple sessions in a single workflow

  • Note: Some features available in single session uploads (like scan selection) are not available in bulk upload mode until after the upload process

For more details on bulk upload workflows, see the official XNAT documentation on uploading image sessions.

Transfer Management

  1. Upload: Click Start Upload. You will be taken to the transfer manager screen where you can: * Monitor upload progress in real-time * Pause, resume, or cancel uploads * Start another workflow while uploads continue in the background

    As long as the application is running and you have an active network connection, uploads will proceed in the background.

For more information on managing transfers, see the official XNAT documentation on managing data transfers.

Project Settings

Some project settings may affect your upload workflow, including:

  • Allow Subject Creation: Whether you can create new subjects during upload

  • Upload Destination: Whether data goes directly to Archive or to Prearchive first

  • Bulk Upload Restrictions: Whether bulk uploads are allowed for the project

  • Series Import Filters: Which scan series are allowed or blocked

These settings may not be enabled for all projects. If you have questions about project-specific settings or encounter restrictions during upload, contact the XNAT NYUAD administrator.

For more information on project settings, see the official XNAT documentation on setting project defaults.

3. Compressed Uploader

The Compressed Uploader is a web-based tool for quickly uploading zipped archives of DICOM sessions. This is useful for single-session uploads or when you already have compressed archives.

Supported Formats: .zip, .tar.gz, or .tgz containing DICOM files.

Instructions

  1. Log in to the XNAT web interface.

  2. In the top navigation bar, go to Upload > Images > Compressed Uploader.

    Compressed Uploader Menu Navigation

    Navigation path: Upload > Images > Compressed Uploader

  3. Select Project: Choose the destination project from the dropdown menu.

  4. Configure Upload Settings: * Importer handler: Select “DICOM Zip” for DICOM files. * Custom Labeling: Choose “Extract From DICOM (Default)” to use DICOM metadata, or “Customize” to manually specify Subject ID and Session Label. * Subject ID and Session Label: If using custom labeling, enter the desired labels. * Ignore unparsable files: Check this option to skip files that cannot be parsed.

  5. Select Destination: * Prearchive: Recommended for safety. This is a temporary holding space that allows you to review and correct metadata before archiving. * Archive: Direct upload. Use only if you are confident in the data integrity and labels.

  6. Choose File: Click Choose File to select your .zip, .tar.gz, or .tgz file.

    Compressed Uploader Page

    Compressed Uploader interface showing project selection, labeling options, destination selection, and file upload

  7. Start Upload: Click Begin Upload. Wait for the confirmation message.

Data Preparation

Regardless of the method used, ensuring your data is organized helps prevent errors.

DICOM Structure Requirements

  • Standard Directory Structure: Keep standard DICOM directory structures. Each session should be in its own folder.

  • Unique IDs: Ensure Patient IDs and Study Instance UIDs are consistent within a session.

  • File Organization: Organize DICOM files in a logical folder hierarchy. Avoid deeply nested folders that may cause issues during upload.

Pre-Upload Checklist

  • Verify that all DICOM files are present and readable

  • Ensure data is properly anonymized (see the Data Anonymization warning in the Important Considerations section above)

  • Remove non-image files (like desktop thumbs, hidden system files, or log files) before zipping for the Compressed Uploader

  • Check that Subject and Session labels follow your project’s naming conventions

  • Verify you have the necessary permissions for the target project

Common File Structure Issues

  • Mixed File Types: Ensure folders contain only DICOM files. Remove any non-DICOM files before upload.

  • Corrupted Files: Corrupted DICOM files may cause upload failures. Verify file integrity before uploading.

  • Incomplete Sessions: Ensure all scan series for a session are included in the upload folder.

Verification After Upload

After completing an upload, it is important to verify that everything uploaded successfully:

  1. Check Upload Logs: Review the upload logs in the Desktop Client transfer manager or check the upload status in the XNAT web interface to confirm all files were transferred successfully.

  2. Verify Data in XNAT: Navigate to your project in the XNAT web interface and verify that: * Subjects were created correctly (if new subjects were created) * Sessions appear with the expected labels * All scan series are present and complete * File counts and sizes match your expectations

  3. Retry Failed Uploads: If any uploads failed, you can retry them from the Desktop Client transfer manager or re-upload via the Compressed Uploader.

  4. Contact Support: If anything isn’t working as expected, or if subjects or sessions were not created properly, contact the XNAT administrators at admin.nyuad.xnat@nyu.edu for assistance.

Troubleshooting

Common Issues

  • Connection Refused (DICOM Receiver): Ensure you are on the correct network (VPN/Intranet) to access 10.230.12.52. For routing issues, verify the DICOM Study Description field contains xnat://project_id/subject_label/session_label. Missing or incorrect routing strings require manual routing from the Prearchive.

  • Permission Errors: Ensure you have “Member” or “Owner” access to the destination project. If subject creation is restricted, register subjects in the project before uploading.

  • Upload Failures: Check file permissions, quota limits, and avoid special characters in Subject/Session labels. Rejected series may be due to Series Import Filters—contact the project administrator if needed.

  • Labeling Issues: Use only alphanumeric characters, hyphens, and underscores. Duplicate labels will merge data with existing sessions.

  • UID Errors During Archiving: If you encounter errors about “Invalid modification of session UID” or see “Conflict” status in Prearchive when merging different sessions, see Resolving UID Errors During Archiving for step-by-step resolution.

  • Bulk Upload Restrictions: Some projects restrict bulk uploads. Upload sessions individually or contact the project administrator.

  • Network/Performance: Large datasets take time to upload. Use the transfer manager to monitor progress. Desktop Client supports resumable uploads if connectivity is interrupted.

For additional help, contact the XNAT administrators at admin.nyuad.xnat@nyu.edu.

See Also

Related Documentation

Official XNAT Documentation