Pega Marketplace Terms of Use
Pega Marketplace
Attachment Migration Wizard
Enhanced AttachmentMigration Wizard with filters, performance tuning, observability for large-scale attachment migration
By using or submitting listings via the Pega Marketplace, you agree to our Terms of Use.
Overview
The standard Pega Attachment Migration Wizard has limitations when dealing with large volumes of attachments. Queries time out, migrations run for days, and there is no granular control over which records are migrated or when the migration runs.
This enhanced Attachment Migration component extends the standard wizard to migrate millions of attachments from the Pega database to external repositories such as Amazon S3 — with full control over scope, timing, and performance. Migrations can be filtered by case type, application, and date-time range, allowing records to move in smaller batches during business off-hours. Batch sizes are configurable, and Queue Processor settings can be tuned to achieve migration rates of up to 450K records per hour.
The component handles edge cases such as duplicate file names and many-to-one attachment relationships that cause lock contention at high throughput. On-demand count loading and an editable target folder path keep the wizard responsive even with millions of records.
Key Features
- Filter by Case Type — Selectively migrate attachments for specific case types instead of all case types in the application.
- Filter by Application — Choose one or more applications to scope migration, including implicit handling of PegaSocial-Message and PegaSocial-Document classes.
- Filter by Create Date-Time Range — Migrate records in incremental batches (200K–300K in 45–60 minutes) during off-hours instead of processing all records at once.
- Configurable Batch Size — Adjust internal batch size from the wizard UI or via DSS settings to optimize throughput.
- Performance-Tuned Queries — Optimized report definitions with additional DB indexes on pxCreateDateTime and pxLinkedRefTo to eliminate slow-running queries and timeouts.
- Queue Processor Performance Tuning — Guidance and configuration for Kafka partitions, QP threads, and background nodes to achieve up to 450K records/hour migration rate.
- Improved Duplicate File Name Handling — Uses timestamp-based renaming instead of random numbers to prevent conflicts during concurrent file migrations.
- On-Demand Attachment Count Loading — Eliminates wizard blocking by loading Link-Attachment and Data-WorkAttach-File counts on-demand via a Refresh Count button.
- Editable Target Folder Path — Allows manual entry of repository folder path, bypassing slow or failing folder browse operations.
Resources
Version
Compatible with
Pega PlatformProduct Owner
Piyush DevaniLast updated
June 11, 2026Product Capability
Data Integration