Made BasicStatisGenerator able to produce stats for more deeply neste…

…d logic data types. PiperOrigin-RevId: 315513234
tensorflow · Jun 9, 2020 · ccb3de4 · ccb3de4
1 parent c193998
commit ccb3de4
Show file tree

Hide file tree

Showing 6 changed files with 689 additions and 181 deletions.
diff --git a/RELEASE.md b/RELEASE.md
@@ -4,6 +4,11 @@
 
 ## Major Features and Improvements
 
+*   Statistics generation is now able to handle arbitrarily nested arrow
+    List/LargeList types. Stats about the list elements' presence and valency
+    are computed at each nest level, and stored in a newly added field,
+    `valency_and_presence_stats` in `CommonStatistics`.
+
 ## Bug Fixes and Other Changes
 
 *   Trigger DATASET_HIGH_NUM_EXAMPLES when a dataset has more than the specified