[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

My TensorBoard isn't showing any data! What's wrong? #6851

Closed
ivanstepanovftw opened this issue May 14, 2024 · 1 comment
Closed

My TensorBoard isn't showing any data! What's wrong? #6851

ivanstepanovftw opened this issue May 14, 2024 · 1 comment

Comments

@ivanstepanovftw
Copy link
ivanstepanovftw commented May 14, 2024
➜  find runs_fmnist_old2 | grep tfevents                                                    
runs_fmnist_old2/20240510-084554 baseline/events.out.tfevents.1715319954.fedora.2347724.0
...
➜  tensorboard --inspect --logdir=runs_fminst_old2                                          
2024-05-15 01:54:18.916940: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-05-15 01:54:19.801501: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
======================================================================
Processing event files... (this can take a few minutes)
======================================================================

No event files found within logdir runs_fminst_old2

Diagnostics

Diagnostics output
--- check: autoidentify
INFO: diagnose_tensorboard.py version c6ca9f1d004e2a1bc7c160abc43be229b82cad7e

--- check: general
INFO: sys.version_info: sys.version_info(major=3, minor=10, micro=14, releaselevel='final', serial=0)
INFO: os.name: posix
INFO: os.uname(): posix.uname_result(sysname='Linux', nodename='fedora', release='6.8.8-300.fc40.x86_64', version='#1 SMP PREEMPT_DYNAMIC Sat Apr 27 17:53:31 UTC 2024', machine='x86_64')
INFO: sys.getwindowsversion(): N/A

--- check: package_management
INFO: has conda-meta: False
INFO: $VIRTUAL_ENV: None

--- check: installed_packages
INFO: installed: tensorboard==2.16.2
INFO: installed: tensorflow==2.16.1
INFO: installed: tensorflow-estimator==2.13.0
INFO: installed: tensorboard-data-server==0.7.2

--- check: tensorboard_python_version
INFO: tensorboard.version.VERSION: '2.16.2'

--- check: tensorflow_python_version
2024-05-15 01:58:05.166932: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-05-15 01:58:06.327591: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
INFO: tensorflow.__version__: '2.16.1'
INFO: tensorflow.__git_version__: 'v2.16.1-0-g5bc9d26649c'

--- check: tensorboard_data_server_version
INFO: data server binary: '/home/USER/.local/lib/python3.10/site-packages/tensorboard_data_server/bin/server'
INFO: data server binary version: b'rustboard 0.7.2'

--- check: tensorboard_binary_path
INFO: which tensorboard: b'/home/USER/.local/bin/tensorboard\n'

--- check: addrinfos
...

--- check: readable_fqdn
INFO: socket.getfqdn(): 'fedora.local'

--- check: stat_tensorboardinfo
INFO: directory: /tmp/.tensorboard-info
...
INFO: mode: 0o40777

--- check: source_trees_without_genfiles
INFO: tensorboard_roots (1): ['/home/USER/.local/lib/python3.10/site-packages']; bad_roots (0): []

--- check: full_pip_freeze
...

Next steps

No action items identified.

Everything was working before, I don't know what happen. Fedora update? Probably not. The only thing that may have caused it is deleted large "http" folder under pip cache folder at home dir. Also I have tried to log gradient histograms.
I have already performed python3.10 -mpip install -U tensorboardX

@ivanstepanovftw
Copy link
Author

Solved: folder is fminst, not fminst. Oh my...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant