See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/837/display/redirect
Changes:
------------------------------------------ [...truncated 7.54 KiB...] Thursday 20 June 2024 01:11:06 +0100 (0:00:01.135) 0:01:02.227 *********
TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Thursday 20 June 2024 01:11:07 +0100 (0:00:00.427) 0:01:02.655 ********* changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Thursday 20 June 2024 01:11:07 +0100 (0:00:00.645) 0:01:03.301 ********* skipping: [localhost]
TASK [Fetch TensorFlow] ******************************************************** Thursday 20 June 2024 01:11:07 +0100 (0:00:00.029) 0:01:03.331 ********* skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] ************************************** Thursday 20 June 2024 01:11:07 +0100 (0:00:00.030) 0:01:03.361 *********
TASK [tensorflow : Create linklibs shell script] ******************************* Thursday 20 June 2024 01:11:07 +0100 (0:00:00.079) 0:01:03.440 ********* changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Thursday 20 June 2024 01:11:08 +0100 (0:00:00.686) 0:01:04.127 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] *** Thursday 20 June 2024 01:11:09 +0100 (0:00:00.621) 0:01:04.749 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] *** Thursday 20 June 2024 01:11:09 +0100 (0:00:00.678) 0:01:05.428 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************ Thursday 20 June 2024 01:11:11 +0100 (0:00:01.534) 0:01:06.962 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] *** Thursday 20 June 2024 01:11:46 +0100 (0:00:35.038) 0:01:42.000 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ****** Thursday 20 June 2024 01:11:47 +0100 (0:00:01.267) 0:01:43.268 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] *** Thursday 20 June 2024 01:11:48 +0100 (0:00:00.782) 0:01:44.051 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ******** Thursday 20 June 2024 01:11:49 +0100 (0:00:00.847) 0:01:44.898 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] *** Thursday 20 June 2024 01:11:50 +0100 (0:00:00.822) 0:01:45.721 ********* changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Thursday 20 June 2024 01:11:51 +0100 (0:00:01.808) 0:01:47.529 ********* ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ------------------- -------------------- -------------------------------------- --------- auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages cryptography 42.0.5 /usr/local/lib/python3.9/dist-packages pip Cython 3.0.9 /usr/local/lib/python3.9/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip keyring 24.3.1 /usr/local/lib/python3.9/dist-packages pip markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip pip 24.0 /usr/local/lib/python3.9/dist-packages pip pkginfo 1.10.0 /usr/local/lib/python3.9/dist-packages pip portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages readme_renderer 43.0 /usr/local/lib/python3.9/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip rich 13.7.1 /usr/local/lib/python3.9/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip setuptools 69.1.1 /usr/local/lib/python3.9/dist-packages pip six 1.14.0 /usr/lib/python3/dist-packages twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip urllib3 2.2.1 /usr/local/lib/python3.9/dist-packages pip wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] *** Thursday 20 June 2024 01:11:52 +0100 (0:00:00.036) 0:01:47.566 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python package] ************* Thursday 20 June 2024 02:09:44 +0100 (0:57:52.046) 0:59:39.613 ********* skipping: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Copy built wheel] ***************** Thursday 20 June 2024 02:09:44 +0100 (0:00:00.033) 0:59:39.646 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) cleanup Bazel install directory] *** Thursday 20 June 2024 02:09:45 +0100 (0:00:00.903) 0:59:40.549 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create script to run tests] ******* Thursday 20 June 2024 02:09:45 +0100 (0:00:00.826) 0:59:41.376 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests] *** Thursday 20 June 2024 02:09:46 +0100 (0:00:00.707) 0:59:42.083 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Thursday 20 June 2024 04:15:07 +0100 (2:05:20.775) 3:05:02.859 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Thursday 20 June 2024 04:15:09 +0100 (0:00:01.939) 3:05:04.799 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Thursday 20 June 2024 04:15:09 +0100 (0:00:00.735) 3:05:05.534 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Thursday 20 June 2024 04:15:10 +0100 (0:00:00.710) 3:05:06.245 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Thursday 20 June 2024 04:15:11 +0100 (0:00:00.704) 3:05:06.950 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Thursday 20 June 2024 04:15:11 +0100 (0:00:00.074) 3:05:07.024 ********* ok: [localhost] => ut_tests_line: 'Executed 3084 out of 3084 tests: 3084 tests pass.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Thursday 20 June 2024 04:15:11 +0100 (0:00:00.038) 3:05:07.063 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests are flaky] ******* Thursday 20 June 2024 04:15:11 +0100 (0:00:00.126) 3:05:07.189 ********* ok: [localhost] => tests_flaky: []
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Thursday 20 June 2024 04:15:11 +0100 (0:00:00.038) 3:05:07.228 ********* ok: [localhost] => tests_failed: []
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Thursday 20 June 2024 04:15:11 +0100 (0:00:00.038) 3:05:07.267 ********* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 3m2.247s user 2m13.455s sys 0m21.376s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w_\a\a\r\c\h\6\4-\2.\1\8.\0-\c\p\3\9-\c\p\3\9-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-linux_aarch64.whl + wheel=/tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow_aarch64-2.18.0-cp39-cp39-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp39-cp39-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp39-cp39-manylinux_2_17_aarch64, cp39-cp39-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..5 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 74546ms # Size of /tf/pkg/tensorflow_aarch64-2.18.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 209 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 18ms ok 3 Wheel is installable in 61222ms ok 4 TensorFlow is importable in 5393ms not ok 5 TensorFlow has Keras in 3942ms # (in test file /usertools/wheel_verification.bats, line 72) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "/tf/venv/lib/python3.9/site-packages/tensorflow/python/util/lazy_loader.py", line 147, in _initialize # import keras # pylint: disable=g-import-not-at-top # File "/tf/venv/lib/python3.9/site-packages/keras/__init__.py", line 23, in <module> # from keras.api import _tf_keras # ImportError: cannot import name '_tf_keras' from 'keras.api' (/tf/venv/lib/python3.9/site-packages/keras/api/__init__.py) # # During handling of the above exception, another exception occurred: # # Traceback (most recent call last): # File "<string>", line 1, in <module> # File "/tf/venv/lib/python3.9/site-packages/tensorflow/python/util/lazy_loader.py", line 181, in __getattr__ # self._initialize() # File "/tf/venv/lib/python3.9/site-packages/tensorflow/python/util/lazy_loader.py", line 161, in _initialize # raise ImportError( # pylint: disable=raise-missing-from # ImportError: Keras cannot be imported. Check that it is installed. stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=39 changed=26 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0
Thursday 20 June 2024 04:20:41 +0100 (0:05:30.030) 3:10:37.298 ********* =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 7520.78s tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git 3472.05s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 330.03s tensorflow_in_container : (Python 3.9) start build container ----------- 35.04s Cleanup after previous build ------------------------------------------- 29.94s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 22.64s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.98s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 1.94s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.81s Gathering Facts --------------------------------------------------------- 1.63s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.53s Create cache dirs ------------------------------------------------------- 1.42s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.27s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow_in_container : (Python 3.9) Copy built wheel ----------------- 0.90s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.85s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.83s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.82s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.78s tensorflow_in_container : (Python 3.9) save list of installed Python packages --- 0.74s Build step 'Execute shell' marked build as failure