Superna Eyeglass® Golden Copy Feature list

Release 1.1.11

  1. Administrator or end user single file download - Fast, secure and easy

    1. Cloud Browser now supports single file recall with simple click to download from Cloud browser GUI​

    2. Admins can quickly download files (versions are not supported in this release)

    3. or end users can login to only download data the have access to in the SMB shares that are backed up.

  2. GUI Enhancements​

    1. Auto refreshed UI for all UI elements​

    2. No cache option added to ensure upgrades force new javascript download post upgrade

    3. New skipped files now in the GUI

    4. Errored jobs GUI, Job history gui

    5. Active file copies across the cluster is now real time in the GUI to see file size and node workload

  3. Job control in the GUI​

    1. You can now pause a job schedule in the GUI and resume the job using the folder definitions UI​

  4. Content Aware Pipelines

    1. Metadata is extracted in real-time during the copy process in a RAM only parsing solution that will extract metadata with file type aware parsing and append this data as custom property on the object.​

    2. Examples

      1. Office documents would have author, title, owner fields added​

      2. images and media would have xpif metadata extracted and applied as tags on objects.  Useful for media & entertainment backup data

      3. DICOM images have rich metadata that would be visible as properties of the objects

      4. png 

    3. Use Cases:

      1. View metadata of files in object storage providing additional details on the files contents

      2. Supports over 1500 file types

      3. Search through backup data in seconds to target restores of data

      4. Future Security solutions in the cloud to make decisions on object data for processing archiving or tiering to lower cost storage tiers. 

  5. System Monitoring​

    1. Per node interface bandwidth real time and historical graphing​.  Track bandwidth usage per node and see the trend over time

  6. Carrier Grade Upgrade - Beta

    1. Upgrade a live Golden Copy cluster without stopping copy jobs or impacting operations.  ​

    2. Node by node rolling upgrade allows copy jobs to progress while each node is upgraded

    3. This is an industry first Enterprise solution with online Enterprise software upgrades for critical infrastructure that cannot go down during upgrades.

    4. NOTE: Requires Multi node Golden  Copy deployment

Release 1.1.9 

  1. GUI updates 

    1. Real time Active file copies per node will show active work on each node and file size

    2. GUI schedule job interface (no more cron)  to schedule incremental or full jobs from the GUI folder create screen

    3. Errors per job view - View errors on copy jobs that shows errors per file and the reason for the failed copy.

    4. Clone Folder definitions in the GUI and change parameters to quickly add new folders based on other folder configurations

    5. Job pause and resume see below for the job engine

  2. Job Engine

    1. The ability to pause or resume a job.  This allows QOS or prioritization of jobs by pausing  a job to allow all copy resources to be dynamically applied to all other running jobs.

  3. Statistics Enhancement​

    1. New Large file copy stats progress (multipart uploads) now update states for parts that are uploaded successfully,   previous behaviour would not update stats until the entire file and all parts were uploaded.   This will reflect in the throughput dashboard to more accurately show real MB's.

    2. MB now used in all stats presentations (finally)

  4. Import and export Configuration​

    1. Export folder definitions can be exported to a file and important them again​

  5. Factory Reset with configuration saved​

    1. factory reset option flag will re-add isilons and all folder definitions​

  6. Tree Walk Enhancements​

    1. Walk once enhancement with stats to indicate environmental issues is blocking kafka commits.  This ensures a tree is not re-walked if there are disk latency issues with the Golden Copy VM's.​

    2. It will also handle media mode symlink or hard link file system loop detection to stop tree walking redundant paths due to loops setup in the file system.

    3. re-walk API calls can fail and now failures are logged in to allow re attempting the treewalk on failed folder API calls​​

Release 1.1.7 

  1. Pipeline Workflow - GA (Pipeline Subscription license)

    1. Data pipelines allows unidirectional copy jobs and metadata tagging to copy to Cloud for burst analysis, ML, rendering or GPU based analysis where data sets created on premise are synced to the cloud for analysis and the output is synced back to on premise storage.​

    2. The pipeline feature will also allow tagging data with tags for cloud applications to route data based on tags on objects.

    3. The pipeline allows triggered or scheduled syncs to Cloud or from Cloud object storage.

    4. Workflow API to copy data via a REST API

  2. Scalability

    1. 99 nodes allows massive Golden Copy clusters for maximum throughput configurations ​

  3. Statistics Enhancement​

    1. New 15 minute counters in the CLI and GUI stats view.  Stats will now show 15 minute , last hour and last day.​

  4. GUI Add Modify Delete Folder Definitions

    1. GUI option to set scheduling of folders for incremental or full archive jobs.​​​

  5. Cloud Browser GA​

    1. Ability to browse copied data directly within Golden Copy GUI without needing to remember access and secret keys. No need for 3rd party tools like cyber duck or S3 Browser needed.​

    2. View object versions and dates and object file size

  6. Cloud Browser Recall Files Portal - Beta

    1. Requires Pipeline license level

    2. Ability to select data from a bucket and launch a recall job from the GUI.

    3. Power user Restore Portal allows users to login with an Active Directory account and see backed up data with the ability to submit recall jobs from the GUI with a Power user role in Golden Copy

  7. Parallel Incremental - Multiple Changelists for Parallel incremental jobs in Onefs - BETA​

    1. Onefs defaults to a single change list at a time.  This feature allows running multiple change lists on different paths at the same time in OneFS and Golden Copy support to manage concurrent change list jobs for Fast Incremental​

  8. Media Mode GA (Pipeline Subscription needed)

    1. Symlink and hard link optimization to eliminate duplicate backup data.

    2. When symlinks or hard links are used object stubs will be auto detected by the Powerscale REST API and only a single copy of the original file will be backed up providing massive cost savings on speed and cost to protect file systems with hard and soft links.

  9. Cluster System Level Backup

    1. Golden copy can protect shares, exports and quotas on protected clusters and store them offsite in S3 buckets.   It also allows complete restore of a clusters configuration information from the S3 bucket from a single command​

  10. Job Transaction log​ Export to the Cloud

    1. This feature allows detail file by file copy information (success, failed, skipped) to be exported every 10 minutes to an S3 bucket.​

    2. This data can be used by applications to monitor file copy audit with data in json format.

  11. Massive Scalability Increase of concurrent jobs​

    1. Ability for concurrent jobs to operate independently with dedicated resources per job vs a pool resource approach allows scaling the number of concurrent copy jobs​

    2. Future proofing for rolling docker container upgrade feature for no down time upgrades.

Release 1.1.6  Update 3

  1. Pipeline Workflow - Beta

    1. Data pipelines allows unidirectional copy jobs and metadata tagging to copy to Cloud for burst analysis, ML, rendering or GPU based analysis where data sets created on premise are synced to the cloud for analysis and the output is synced back to on premise storage.​

    2. The pipeline feature will also allow tagging data with tags for cloud applications to route data based on tags on objects.

    3. The pipeline allows triggered or scheduled syncs to Cloud or from Cloud object storage.

    4. Workflow API to copy data via a REST API

  2. Golden Copy GUI GA status​

    1. The gui allows monitoring all active copy jobs, job history and stats, key stats on all jobs or filter per folder.

    2. The GUI has historical performance graphs to monitor copy jobs over time.  ​

  3. Email summary notifications​

    1. Configure summary email every day to email progress of active copy jobs without needed to login to the GUI or CLI​

  4. Higher job limits for concurrent jobs​

  5. Stats Engine Memory Improvement
    1. Long term stats with grafana 

  6. Data Integrity Audit Job Enhancements (Advanced license key only)

    1. Run a data integrity audit job to sample backup data and download and recompute checksum compared to check sum when the data was backed up.

  7. Job History Filtering

    1. Ability to filter job history by folder ID

    2. Filter based on last x events

    3. Scalability added to persist job history to kafka topic for long term retention

  8. Recall Data Performance Improvement​

    1. Single step recall now applies metadata as data is recalled.​

    2. Recall without metadata is 2x faster for restore of data without metadata

  9. Recall All Data

    1. Object data modified in the S3 bucket will be recalled,  new data copied to the S3 target that was not copied by Golden Copy will also be recalled. This allows cloud work flows to use the data in S3, add new data​

  10. Golden Copy Automation API - Beta

    1. API that allows:​

      1. add folder folder​

      2. start job (full archive or recall job)

      3. monitor progress

      4. Cancel a running job

      5. start a folder report export job to produce json report

      6. re-run an existing job with failed fils

      7. remove a folder

      8. test a folder with the test feature after it is added

      9. recall data

  11. Parallel Incremental - Multiple Changelists for Parallel incremental jobs in Onefs - BETA​

    1. Onefs defaults to a single change list at a time.  This feature allows running multiple change lists on different paths at the same time in OneFS and Golden Copy support to manage concurrent change list jobs for Fast Incremental​

Release 1.1.6 Update 2 Advanced License Required

  1. Full Backup mode creates scheduled full backups and works with bucket life cycle management to expiry backups automatically

  2. Redirected recall of data to clusters without a Golden Copy license

  3. Version aware re-call workflow for incremental always version aware backup and restore work flow.  Allows restoring a specific time period, where file versions are checked if they match the requested restore time period.

  4. Ransomware Defender Airgap integration - Allows Golden Copy to learn about the Airgap status and suspend copy operations to S3 targets if Ransomware Defender has active alerts.

Release 1.1.6 Advanced License Required

  1. Backup reporting statistics for Backup paths

  2. Native Cloud provider tier support

    1. Allows copying data directly into the target tier without transition costs between tiers.

    2. Recalling data will automatically recall data from an archive tier without any user actions in the Cloud providers console.

Release 1.1.4 update 5 Basic License

  1. Scalability

    1. Doubles concurrent job execution performance to 80 concurrent jobs

      1. concurrent incremental jobs 80​

      2. concurrent full copies 5

    2. Increases scalability to Scale out Virtual accelerators to 9 VAN VM's

  2. Security

    1. RBAC CLI Roles - allows creation of AD enabled roles to create different administrator roles by mapping CLI commands to a group.

      1. Active Directory integrated login enables SSH login with AD user accounts​

    2. Appliance hardening of the appliance management with builtin banned user with failed login attempts

Release 1.1.4 update 4

  1. Automated Data audit - Samples data randomly, downloads the files and calculates the checksum on the file and compares to checksum property stored with the file.  This audit verifies your object target data integrity.  Requires MD5 mode enabled and will accept a quantity of data in GB's to randomly audit the data integrity. 

  2. Updated Dell ECS Builtin Load Balancer removes the need for external load balancer to simplify and reduce cost of object solutions.   Add or delete ECS data nodes to load balance copies to different ECS nodes to increase copy performance.

  3. Incremental on Demand -  Normally incremental jobs in sync mode are scheduled.  This feature allows the archive command to specify incremental on demand to change list the folder and only copy the changes detect to the object target.

  4. Vertical Scaled Single VM - Increasing resources on a single Golden Copy VM allows performance improvements before needing to expanding to virtual accelerator nodes.


Release 1.1.4 update 3

  1. Virtual node Accelerators (VANs) - small file and big file load balancing allows Isilon hardware nodes to handle large file multipart splitting and uploads and off load small file copying to virtual node accelerators.

Release 1.1.4 update 2

  1. Secure Mode - Allows administrator login to Active Directory with proxy login through Isilon auth providers.   Local login denies CLI access until authentication session to enable CLI access.

  2. Virtual node Accelerators (VANs) -  Small VM's that extend the copy throughout that allows scale out copy performance externally from the Isilon cluster hardware nodes.

    1. Expand copy performance by adding virtual accelerator nodes, 2G ram , 30G local disk.   Hot add virtual nodes to expand copy performance​

  3. Per folder Archive full and incremental scheduling option to customize each folders schedule.

    1. Allows funning full archive audit or incremental jobs using Isilon change list api or both job types on the same folder

  4. Recall mode real-time performance with the searchctl jobs view command using the --follow flag

  5. Search & Recovery import copy allows customers with Search & Recover to search for data using any criteria required including data age (last modified or last accessed time stamps).

    1. Use Case - Archive Stale Data to S3 objects: 

      1. Search for Stale data with What's Growing Old? Quick report and export the results to CSV file.​

      2. Import the CSV to Golden Copy to start an archive job using the CSV as input

      3. Use Search & Recover  command builder to generate a script to move archived data to a staging area or delete the files to save space

      4. Enable the new feature in 1.1.5 to index S3 objects to allow searching for archived data.

      5. Search for archived data with Search & Recover UI and export a list of files.  Import the list of files to Golden Copy to start a recall job to return archived data to the file system. 

Release 1.1.4  Key Features Golden Copy:

  1. Real time CLI copy job monitoring

  2. Bulk Data Loading

    1. Support for Amazon AWS S3 Snowball bulk data loading​

    2. Support for Microsoft Azure Blob Storage bulk data loading with Data Box

  3. New stats for copy jobs and recalls

  4. Copy job report creation is background job with speed improvements to generate summary reports and full list of copied files

  5. CLI command to summarize all failure reasons for failed files on a copy job, simplifies debugging any failed file copies

  6. Test feature to check permissions, authentication, with test file create delete before starting a copy job

  7. Support for selecting a Snapshot as a source path to copy

  8. Support for selecting read-only DR syncIQ data as a source path to copy

  9. Support for Internet proxy devices to reach Cloud provider storage services

  10. Copy job with automatic re-run option to reattempt any failed file uploads

    1. Re-run only failed file copies on any previous copy job​

  11. Data Recall Job to allow bulk data recall from Object back to File

    1. Data Recall from object to file (no meta data) 

    2. Same cluster or different cluster (no license key requirement on recalls) - Beta Feature​ 

    3. Metadata reapply (permissions, owner and some data stamps) - Beta Feature

    4. Date Range Data Recall - Beta Feature

    5. Ability to recall only data and skip meta data of the data

  12. Show Copy rate in MB/s web report

  13. Full GUI Dashboard with real-time monitoring - Beta Feature

  14. File system Tree walk speed enhancement to use Search & Recover Distributed BFS Algorithm 

  15. Ability to add Include / Exclude paths with filters to skip copying specific paths or file types

  16. Golden Copy Phone Home for remote log collection and monitoring

Key Features Previous Releases:

  1. Copy or sync Mode of a path to S3 storage

    1. Isilon Snapshot aware point in time copy or sync

  2. ​Free up Isilon usable space by reducing snapshot retentions and copy  S3 storage for long term archive 

  3. Copy Existing Isilon Snapshots to S3 storage for long term retention

  4. Sync Mode uses Isilon change list for incremental copies

    1. Delayed Delete in Sync mode to move deleted files to delete storage bucket

  5. Rate limiting option per path in Mbps​

  6. No load balancer required for on premise S3 multi node storage with load balancing file copies

  7. Smartconnect load balancing of copy work load across Isilon nodes

  8. Meta data protection stored in S3 objects for files and folders (ACL's, owner, group, mode bits, date stamps)

  9. Native file format copies and folder structure is preserved

  10. Restore full or partial with meta data restored to Isilon file system

    1. Redirected restore to a different Isilon

    2. Single file restore with any S3 Browser tool​

  11. Dual copy a folder to multiple S3 targets

  12. S3 supported targets Dell ECS and AWS S3 (Glazier or deep archive),  Azure blob, Cohesity