Support Site Overview
Self-Learning
Data Education Center
Release Notes
License Transfers
Support FAQ
Knowledge Base
Documentation
CoSort 10.5 Release Notes
CoSort 10.5
Jun 30, 2021
* CoSort 10.5
a) Database Lookups
As an alternative to drawing values from external set files, it is now also possible in SortCL /FIELD statements to use some existing SET file attributes in conjunction with values in a DSN-connected database table.
b) Data Vault Support
IRI Workbench now provides a wizard in the Voracity menu to generate a Data Vault table with RDB production schema or synthetic test data.
c) Sybase and MS SQL Date Handling
Current time, data and timestamp data types are now supported.
d) EPWD, EUID, EPASS, and cspasswd
Encrypted usernames and passwords may be specified in the ODBC connection string by using "EUID:encrypted_username" and "EPWD:encrypted_password" in place of UID and PWD followed by clear text.
Encrypted passphrases may be specified as an argument to encryption functions with the syntax "EPASS:encrypted_passphrase" in place of the clear text passphrase.
The "cspasswd" executable is included in the CoSort product distribution to be used to encrypt the password or username for EPWD, EUID, and EPASS.
e) Encrypted credentials in ODBC connection strings
User IDs and passwords for database connections can be optionally encrypted when used in a job script.
f) Empty tags or attributes in XML output
The existing resource control setting, ON_EMPTY_OBJECT_VALUE, may be set to REMOVE_EMPTY to prevent the writing of tags and attributes with empty values in XML output. This setting was previously only applicable to JSON formatted output.
g) Legacy Numeric Output
The new resource control setting, LEGACY_NUMERIC_OUTPUT, is available to revert the reformatting of output records to the way they were handled in CoSort 9. When set to 0 or OFF (the default) NUMERIC output is reformatted to assert output field precision. When set to 1 or ON, NUMERIC output precision is only enforced when the field precision or data type has changed.
h) /PROCESS=ASN.1
SortCL now supports the processing of files based on any ASN.1 schema and encoding. asn1_2ddf, a new metadata utility for ASN.1 encoded files, has been developed to aid in gathering metadata from such files for use with SortCL.
i) /PROCESS=XLS and /PROCESS=XLSX
Reading and writing cell data from .xls and .xlsx spreadsheet files is now supported. Additionally, xls2ddf, a new metadata utility for XLS and XLSX files, is included.
j) Location DEF Expansion
SDEF has been added as a new field location definition to be used with XLS and XLSX formats.
CDEF has been added as a new field attribute to support CSV output column names that do not comply with field name restrictions. This includes UTF-8 characters and names with leading digits or embedded white space.
k) Eclipse Upgrade
IRI Workbench supporting CoSort 10 and other IRI tools is now based on Eclipse 2020-06 and 64-bit JRE 1.8.
l) New Integrations with Splunk and Value Labs
A purpose-built app for Splunk directly executes and consumes job data from SortCL and compatible IRI programs. The ValueLabs Test Data Hub can also create, modify, and launch SortCL scripts for data masking and synthesis jobs.
m) Discovery Dashboards in IRI Workbench
A number of visualizations can now be generated from the Data Class Schema (and Directory) Search wizards in addition to their traditional log output.
As an alternative to drawing values from external set files, it is now also possible in SortCL /FIELD statements to use some existing SET file attributes in conjunction with values in a DSN-connected database table.
b) Data Vault Support
IRI Workbench now provides a wizard in the Voracity menu to generate a Data Vault table with RDB production schema or synthetic test data.
c) Sybase and MS SQL Date Handling
Current time, data and timestamp data types are now supported.
d) EPWD, EUID, EPASS, and cspasswd
Encrypted usernames and passwords may be specified in the ODBC connection string by using "EUID:encrypted_username" and "EPWD:encrypted_password" in place of UID and PWD followed by clear text.
Encrypted passphrases may be specified as an argument to encryption functions with the syntax "EPASS:encrypted_passphrase" in place of the clear text passphrase.
The "cspasswd" executable is included in the CoSort product distribution to be used to encrypt the password or username for EPWD, EUID, and EPASS.
e) Encrypted credentials in ODBC connection strings
User IDs and passwords for database connections can be optionally encrypted when used in a job script.
f) Empty tags or attributes in XML output
The existing resource control setting, ON_EMPTY_OBJECT_VALUE, may be set to REMOVE_EMPTY to prevent the writing of tags and attributes with empty values in XML output. This setting was previously only applicable to JSON formatted output.
g) Legacy Numeric Output
The new resource control setting, LEGACY_NUMERIC_OUTPUT, is available to revert the reformatting of output records to the way they were handled in CoSort 9. When set to 0 or OFF (the default) NUMERIC output is reformatted to assert output field precision. When set to 1 or ON, NUMERIC output precision is only enforced when the field precision or data type has changed.
h) /PROCESS=ASN.1
SortCL now supports the processing of files based on any ASN.1 schema and encoding. asn1_2ddf, a new metadata utility for ASN.1 encoded files, has been developed to aid in gathering metadata from such files for use with SortCL.
i) /PROCESS=XLS and /PROCESS=XLSX
Reading and writing cell data from .xls and .xlsx spreadsheet files is now supported. Additionally, xls2ddf, a new metadata utility for XLS and XLSX files, is included.
j) Location DEF Expansion
SDEF has been added as a new field location definition to be used with XLS and XLSX formats.
CDEF has been added as a new field attribute to support CSV output column names that do not comply with field name restrictions. This includes UTF-8 characters and names with leading digits or embedded white space.
k) Eclipse Upgrade
IRI Workbench supporting CoSort 10 and other IRI tools is now based on Eclipse 2020-06 and 64-bit JRE 1.8.
l) New Integrations with Splunk and Value Labs
A purpose-built app for Splunk directly executes and consumes job data from SortCL and compatible IRI programs. The ValueLabs Test Data Hub can also create, modify, and launch SortCL scripts for data masking and synthesis jobs.
m) Discovery Dashboards in IRI Workbench
A number of visualizations can now be generated from the Data Class Schema (and Directory) Search wizards in addition to their traditional log output.
