Commits

Breadcrumbs

History for

onv1.15.1

User selector

All users

All time

Commit History

Commits on Apr 14, 2023

• Automated rollback of commit cb3b5fe

  

  caveness

  authored and

  tfx-copybara

  committedApr 14, 2023
  ad65a9d

Commits on Apr 13, 2023

• Automated rollback of commit fb2ad72

  

  caveness

  authored and

  tfx-copybara

  committedApr 13, 2023
  cb3b5fe

• Move utility functions for interacting with Arrow record batches and arrays to TFX-BSL.

  

  caveness

  authored and

  tfx-copybara

  committedApr 13, 2023
  fb2ad72

Commits on Jan 31, 2023

• Rename statistics_io_impl to reflect that it is used for artifact I/O beyond stats.

  

  caveness

  authored and

  tfx-copybara

  committedJan 31, 2023
  7dad90d

Commits on Jun 29, 2022

• Adds utility for converting drift_skew_info to dataframe, and stats view usability improvement.

  

  zwestrick

  authored and

  tfx-copybara

  committedJun 29, 2022
  54773f1

Commits on Jun 22, 2022

• Automated rollback of changelist 450795394

  

  zwestrick

  authored and

  tfx-copybara

  committedJun 22, 2022
  a4290ae

Commits on May 2, 2022

• Changes tfdv and tfx-bsl to use renamed derived source fields, and removes the old names from the proto.

  

  zwestrick

  authored and

  tfx-copybara

  committedMay 2, 2022
  151d1f7

Commits on Apr 13, 2022

• TFDV: adds a helper to in memory stats API for fetching a derived feature given a deriver name and source paths.

  tfx-copybara

  committedApr 13, 2022
  8ec38a8

Commits on Apr 6, 2022

• Minor usability improvement to statistics view class to allow passing strings for length 1 paths, and Iterable[str] in place of types.FeaturePath.

  tfx-copybara

  committedApr 6, 2022
  7ee1514

Commits on Feb 8, 2022

• Renames WriteStatisticsToTFRecordAndBinaryFile to WriteStatisticsToRecordsAndBinaryFile and marks it as experimental.

  tfx-copybara

  committedFeb 8, 2022
  f56efc8

Commits on Feb 2, 2022

• Fixes bug in load_statistics.

  tfx-copybara

  committedFeb 2, 2022
  88d889d

Commits on Feb 1, 2022

• Simplified experimental sharding logic for TFDV. Now output shards are guaranteed to contain all statistics for a subset of features.

  tfx-copybara

  committedFeb 1, 2022
  0d5d1ce

Commits on Jan 4, 2022

• Introduce an API for reading sharded stats, which returns a wrapper class handling field access.

  tfx-copybara

  committedJan 4, 2022
  59e2dcd

Commits on Nov 17, 2021

• Internal Google change

  tfx-copybara

  committedNov 17, 2021
  a4cf6f4

Commits on Sep 28, 2020

• Added a load_stats_binary function to load stats proto from a file that stores the serialized proto.

  

  brills

  authored and

  tfx-copybara

  committedSep 28, 2020
  1c37aed

Commits on Jun 9, 2020

• Made BasicStatisGenerator able to produce stats for more deeply nested logic data types.

  

  brills

  authored and

  tfx-copybara

  committedJun 9, 2020
  ccb3de4

Commits on May 14, 2020

• Added support for nested lists (list<list<...>>) types for most stats generators that flattens by introducing arrow_util.flatten_nested() which flattens an arbirarily nested array.

  

  brills

  authored and

  tfx-copybara

  committedMay 14, 2020
  c709732

Commits on May 13, 2020

• Add ptransforms to write statistics to text and tfrecord files.

  

  paulgc

  authored and

  tfx-copybara

  committedMay 13, 2020
  38f3679

Commits on May 8, 2020

• Add utility methods tfdv.get_slice_statistics to get statistics for a slice and tfdv.compare_slices to compare statistics of two slices using Facets.

  

  paulgc

  authored and

  tfx-copybara

  committedMay 8, 2020
  8818451

Commits on May 7, 2020

• Automated rollback of commit 5d0fea8

  tfx-copybara

  committedMay 7, 2020
  824c6fa

Commits on May 5, 2020

• Automated rollback of commit 911f838

  tfx-copybara

  committedMay 5, 2020
  5d0fea8

• Automated rollback of changelist 309087818

  tfx-copybara

  committedMay 5, 2020
  911f838

Commits on Feb 7, 2020

• Added support for Large variants of ListArrays and BinaryArrays.

  

  brills

  authored and

  tfx-copybara

  committedFeb 7, 2020
  630279d

Commits on Jan 31, 2020

• Remove special handling of pyarrow and TF import order.

  

  caveness

  authored and

  tfx-copybara

  committedJan 31, 2020
  4332531

Commits on Jan 10, 2020

• Stopped using TF internal API for file I/O. Instead, use TF public tf.GFile.

  

  brills

  authored and

  tfx-copybara

  committedJan 10, 2020
  b73bcd3

Commits on Oct 1, 2019

• Update get_weight_feature to be used with Arrow table inputs and use same in arrow_util.enumerate_arrays.

  

  caveness

  authored and

  tf-data-validation-team

  committedOct 1, 2019
  71dc7d8

Commits on Aug 8, 2019

• Added basic support for generate stats of STRUCT type.

  

  brills

  authored and

  tf-data-validation-team

  committedAug 8, 2019
  5256a0c

Commits on Jul 29, 2019

• Add Python types to the source code.

  

  paulgc

  authored and

  tf-data-validation-team

  committedJul 29, 2019
  a93f532

Commits on Jul 17, 2019

• Introduced a FeaturePath class to represent feature paths. This is to prepare for

  

  brills

  authored and

  tf-data-validation-team

  committedJul 17, 2019
  9f20969

Commits on Jul 10, 2019

• Upgrade arrow to 0.14.0

  

  paulgc

  authored and

  tf-data-validation-team

  committedJul 10, 2019
  d070caa

Commits on Apr 18, 2019

• Fix #58

  

  paulgc

  authored and

  tf-data-validation-team

  committedApr 18, 2019
  9d98c7a

Commits on Apr 17, 2019

• Introduced ArrowCombinerStatsGenerator and Made BasicStatsGenerator one of that.

  

  brills

  authored and

  tf-data-validation-team

  committedApr 17, 2019
  a26c15a

Commits on Apr 16, 2019

• Refactor is_valid_utf8 into maybe_decode_utf8, which returns the decoded text if the input could be decoded.

  

  tf-data-validation-team

  committedApr 16, 2019
  6f13448

Commits on Feb 22, 2019

• Add utility functions to write and load DatasetFeatureStatisticsList protos.

  

  tf-data-validation-team

  committedFeb 22, 2019
  c465f12

Commits on Feb 14, 2019

• Support for semantic domains in schema inference

  

  tf-data-validation-team

  committedFeb 14, 2019
  1496c7d

Pagination

PreviousNext