[go: nahoru, domu]
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Aborted (core dumped) in tf.io.TFRecordWriter #63337

Open
vwrewsge opened this issue Mar 9, 2024 · 4 comments
Open

Aborted (core dumped) in tf.io.TFRecordWriter #63337

vwrewsge opened this issue Mar 9, 2024 · 4 comments
Assignees
@Venkat6871
Labels
comp:ops OPs related issues stat:awaiting tensorflower Status - Awaiting response from tensorflower TF 2.15 For issues related to 2.15.x type:bug Bug

Comments

@vwrewsge
Copy link
vwrewsge commented Mar 9, 2024 •
edited
Loading

Issue type

Bug

Have you reproduced the bug with TensorFlow Nightly?

Yes

Source

binary

TensorFlow version

tf 2.15

Custom code

Yes

OS platform and distribution

Linux Ubuntu 20.04

Mobile device

No response

Python version

3.9

Bazel version

No response

GCC/compiler version

No response

CUDA/cuDNN version

No response

GPU model and memory

No response

Current behavior?

I have tested on tensorflow-nightly.
There are five bugs related to tf.io.TFRecordWriter.

BUG 1: compression_method=3 -> Aborted (core dumped)
Code:

import tensorflow as tf
input_data = b'input_data_example'
options = tf.io.TFRecordOptions(compression_type='ZLIB', compression_method=3)
with tf.io.TFRecordWriter('output.tfrecord', options=options) as writer:
    writer.write(input_data)

BUG 2: window_bits=-8 -> Aborted (core dumped)
CODE:

import tensorflow as tf
input_data = b'input_data_example'

options = tf.io.TFRecordOptions(
    compression_type='ZLIB',
    window_bits=-8  # negative window_bits
)

with tf.io.TFRecordWriter('output.tfrecord', options=options) as writer:
    writer.write(input_data)

BUG3: compression_level=-9 -> Aborted (core dumped)
CODE:

import tensorflow as tf
input_data = b'input_data_example'
options = tf.io.TFRecordOptions(compression_type='ZLIB', compression_level=-9)
with tf.io.TFRecordWriter('output.tfrecord', options=options) as writer:
    writer.write(input_data)

BUG 4: mem_level=-10 -> Aborted (core dumped)
CODE:

import tensorflow as tf
input_data = b'input_data_example'
options = tf.io.TFRecordOptions(compression_type='ZLIB', mem_level=-10)
with tf.io.TFRecordWriter('output.tfrecord', options=options) as writer:
    writer.write(input_data)

BUG 5: compression_strategy=-2 -> Aborted (core dumped)

import tensorflow as tf

input_data = b'input_data_example'
options = tf.io.TFRecordOptions(compression_type='ZLIB', compression_strategy=-2)
with tf.io.TFRecordWriter('output.tfrecord', options=options) as writer:
    writer.write(input_data)

Standalone code to reproduce the issue

The reproducible test cases are provided above.

Relevant log output

All the above codes output `Aborted (core dumped)`.
@google-ml-butler google-ml-butler bot added the type:bug Bug label Mar 9, 2024
@Venkat6871
Copy link

Hi @vwrewsge ,

I tried to run your code on colab using tf-nightly and faced same issue. Please find the gist here for reference. We need to work on it, In few days i will provide a solution for it.

Thank you!

@Venkat6871 Venkat6871 added TF 2.15 For issues related to 2.15.x subtype: ubuntu/linux Ubuntu/Linux Build/Installation Issues comp:apis Highlevel API related issues labels Mar 11, 2024
@Venkat6871
Copy link
Venkat6871 commented May 21, 2024 •
edited
Loading

Hi @vwrewsge ,

  • I tried alternative approaches for compression_method and window_bits. I hope it will use for you. Here i am providing gist for your reference.

Thank you!

@Venkat6871 Venkat6871 added stat:awaiting response Status - Awaiting response from author and removed subtype: ubuntu/linux Ubuntu/Linux Build/Installation Issues labels May 21, 2024
@github-actions GitHub Actions
Copy link

This issue is stale because it has been open for 7 days with no activity. It will be closed if no further activity occurs. Thank you.

@github-actions github-actions bot added the stale This label marks the issue/pr stale - to be closed automatically if no activity label May 29, 2024
@vwrewsge
Copy link
Author

Hi @vwrewsge ,

  • I tried alternative approaches for compression_method and window_bits. I hope it will use for you. Here i am providing gist for your reference.

Thank you!

Thank you for your reply. Would it be better to add a validation check to handle these edge cases? Something like Fix checkfail

@google-ml-butler google-ml-butler bot removed stale This label marks the issue/pr stale - to be closed automatically if no activity stat:awaiting response Status - Awaiting response from author labels May 29, 2024
@Venkat6871 Venkat6871 added comp:ops OPs related issues stat:awaiting tensorflower Status - Awaiting response from tensorflower and removed comp:apis Highlevel API related issues labels May 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Venkat6871 Venkat6871

Labels
comp:ops OPs related issues stat:awaiting tensorflower Status - Awaiting response from tensorflower TF 2.15 For issues related to 2.15.x type:bug Bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Venkat6871 @vwrewsge