Mainframe Connector release notes

This page contains release notes for features and updates to Mainframe Connector.

You can see the latest product updates for all of Google Cloud on the Google Cloud page, browse and filter all release notes in the Google Cloud console, or programmatically access release notes in BigQuery.

To get the latest product updates delivered to you, add the URL of this page to your feed reader, or add the feed URL directly: https://cloud.google.com/feeds/mainframeconnector-release-notes.xml

July 01, 2024

v5.12.0

Mainframe Connector 5.12.0 supports the following new features:

  • The gsutil cp command supports some performance improvements. For more information, see Performance improvements for the gsutil cp command.
  • The bq export command supports the Native copybook parser. We recommend that you explicitly set the Native copybook parser using the --parser_type=native flag. For more information, see Define the copybook parser. This ensures that Mainframe Connector doesn't fall back to the Legacy copybook parser in case of copybook syntax errors.
  • Supports all double-byte character set (DBCS) textual types (N/G). DBCS fields that are not surrounded by SO/SI should have a _DBCS or -DBCS field suffix.
  • Supports both single and double IBM hexadecimal floating point (HFP) data types for copybook fields.
  • Supports bq query audit logs.
  • Supports the following log improvements:
    • New and improved logging format
    • More resilient Cloud Logging implementation
    • The scp command prints the file size and the number of records
    • The Remote transcoding process prints the version number
    • Displays an error when you use the deprecated PIC T field with the Native copybook parser
  • Mainframe Connectors displays an updated error when deprecated PIC T is used with the new copybook parser.
  • Commands in the remote mode can use the option remoteUrl instead of remoteHost and remotePort. The remoteUrl should contain the scheme, host, and port. If the scheme is https and no trust store is provided as an option or environment variable, the system's default trust store is used.

The following issues are fixed in Mainframe Connector 5.12.0:

  • Fixed the issue where the gsutil cp command statistic miscounts added rows when the error count was more than 0. This is only applicable if you set the --maxErrorPct flag to a value greater than 0. The --maxErrorPct argument for gsutil cp command is also fixed. By default, the value is 0.0, which means failure on copybook or data error.
  • Fixed the --parallelism argument for the gsutil cp command.
  • Fixed incorrect error handling for any issues in the copybook. For example, the Mainframe Connector job should fails or aborts if there are errors such as data type mismatches the data, or there's a logical record length (LRECL) mismatch.
  • Fixed cases where remote transcoding replaced underscore (_) in the column name with (-) in the copybook. To disable this behavior during both local and remote transcoding, set the BQSH_FEATURE_CONVERT_UNDERSCORE_IN_FIELDS_NAME feature flag to true.
  • Fixed zoned decimal binary data decoding when the zoned decimal has more than 19 digits, and contains a decimal point.
  • Fixed gsutil cp command to work with uncompressed files. The command previously accepted gzip flies only.
  • Shows an explicit error message when you use REDEFINE keyword as REDEFINE is not supported.
  • Fixed the declaration of big numbers with decimal point (numbers with more than 19 digits) in BigQuery. These numbers were declared as STRINGS instead of BIGNUMERIC.
  • Fixed gsutil cp command to work when the source file is located in Cloud Storage and the converted file's destination is also in Cloud Storage.

May 02, 2024

v5.11.0

Mainframe Connector 5.11.0 supports the following new features:

The following issue are fixed in Mainframe Connector 5.11.0:

  • Optimized gsutil cp string handling performance.

Mainframe Connector 5.11.0 has the following open issue:

  • Zoned decimal bin data is incorrectly decoded when the zoned decimal has more than 18 digits, and contains a decimal point.

March 28, 2024

v5.10.0

Mainframe Connector 5.10.0 supports the following new features:

  • Support for Cloud Run remote service deployment using Terraform.
  • Support for the bq export command with Mainframe Connector Remote Service.
  • Optimized bq query command with the split_sql=true field that supports the following:
    • Skips SQL statements with only comments.
    • Makes split_sql=true as the default mode which splits multiple SQL statements into multiple requests that are executed in parallel.

The following issues are fixed in Mainframe Connector 5.10.0:

  • Fixed the recursive mode --recursive of the gsutil rm command.
  • Fixed the issue where the bq export command with more than nine parts or rows was exported out of order when all the data was loaded.
  • Fixed the issue where the bq export command issued more queries than necessary.
  • Fixed the issue where the bq export command generated redundant empty parts.
  • Fixed the issue of parsing Varchar fields - In the old copybook parser, Varchar fields of the size of 1000 and above are parsed as a Byte data type. In the new copybook parser, Varchar fields of the size of 1000 and above are parsed as a String datatype. If you want to parse Varchar fields of any size as a Byte data type in the new copybook parser, ensure that the Picture (PIC) name ends with BTYE or BT.

Mainframe Connector 5.10.0 has the following open issue:

  • The bq export command doesn't support the new copybook parser.