See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/746/display/redirect
Changes:
------------------------------------------ [...truncated 7.98 KB...] skipping: [localhost]
TASK [Fetch TensorFlow] ******************************************************** Thursday 21 March 2024 00:14:26 +0000 (0:00:00.042) 0:04:19.301 ******** skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] ************************************** Thursday 21 March 2024 00:14:26 +0000 (0:00:00.036) 0:04:19.337 ********
TASK [tensorflow : Create linklibs shell script] ******************************* Thursday 21 March 2024 00:14:26 +0000 (0:00:00.086) 0:04:19.423 ******** changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Thursday 21 March 2024 00:14:27 +0000 (0:00:00.818) 0:04:20.242 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] *** Thursday 21 March 2024 00:14:28 +0000 (0:00:00.694) 0:04:20.937 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] *** Thursday 21 March 2024 00:14:29 +0000 (0:00:00.811) 0:04:21.748 ******** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************ Thursday 21 March 2024 00:14:33 +0000 (0:00:03.779) 0:04:25.528 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] *** Thursday 21 March 2024 00:23:50 +0000 (0:09:17.875) 0:13:43.403 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ****** Thursday 21 March 2024 00:23:53 +0000 (0:00:02.447) 0:13:45.850 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] *** Thursday 21 March 2024 00:23:55 +0000 (0:00:01.804) 0:13:47.655 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ******** Thursday 21 March 2024 00:23:57 +0000 (0:00:01.875) 0:13:49.531 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] *** Thursday 21 March 2024 00:23:59 +0000 (0:00:02.190) 0:13:51.721 ******** changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Thursday 21 March 2024 00:24:04 +0000 (0:00:04.818) 0:13:56.540 ******** ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ------------------- -------------------- -------------------------------------- --------- auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages cryptography 42.0.5 /usr/local/lib/python3.9/dist-packages pip Cython 3.0.9 /usr/local/lib/python3.9/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip keyring 24.3.1 /usr/local/lib/python3.9/dist-packages pip markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip pip 24.0 /usr/local/lib/python3.9/dist-packages pip pkginfo 1.10.0 /usr/local/lib/python3.9/dist-packages pip portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages readme_renderer 43.0 /usr/local/lib/python3.9/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip rich 13.7.1 /usr/local/lib/python3.9/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip setuptools 69.1.1 /usr/local/lib/python3.9/dist-packages pip six 1.14.0 /usr/lib/python3/dist-packages twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip urllib3 2.2.1 /usr/local/lib/python3.9/dist-packages pip wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] *** Thursday 21 March 2024 00:24:04 +0000 (0:00:00.047) 0:13:56.587 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python package] ************* Thursday 21 March 2024 01:25:11 +0000 (1:01:07.766) 1:15:04.354 ******** skipping: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Copy built wheel] ***************** Thursday 21 March 2024 01:25:11 +0000 (0:00:00.033) 1:15:04.387 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) cleanup Bazel install directory] *** Thursday 21 March 2024 01:25:12 +0000 (0:00:00.919) 1:15:05.307 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create script to run tests] ******* Thursday 21 March 2024 01:25:13 +0000 (0:00:00.901) 1:15:06.208 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests] *** Thursday 21 March 2024 01:25:14 +0000 (0:00:00.718) 1:15:06.927 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Thursday 21 March 2024 03:23:33 +0000 (1:58:18.928) 3:13:25.855 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Thursday 21 March 2024 03:23:35 +0000 (0:00:01.904) 3:13:27.760 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Thursday 21 March 2024 03:23:35 +0000 (0:00:00.680) 3:13:28.440 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Thursday 21 March 2024 03:23:36 +0000 (0:00:00.743) 3:13:29.184 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Thursday 21 March 2024 03:23:37 +0000 (0:00:00.694) 3:13:29.879 ******** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Thursday 21 March 2024 03:23:37 +0000 (0:00:00.073) 3:13:29.952 ******** ok: [localhost] => ut_tests_line: 'Executed 3069 out of 3069 tests: 3069 tests pass.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Thursday 21 March 2024 03:23:37 +0000 (0:00:00.038) 3:13:29.991 ******** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests are flaky] ******* Thursday 21 March 2024 03:23:37 +0000 (0:00:00.122) 3:13:30.113 ******** ok: [localhost] => tests_flaky: []
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Thursday 21 March 2024 03:23:37 +0000 (0:00:00.039) 3:13:30.153 ******** ok: [localhost] => tests_failed: []
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Thursday 21 March 2024 03:23:37 +0000 (0:00:00.063) 3:13:30.217 ******** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 2m55.498s user 2m8.780s sys 0m20.375s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w_\a\a\r\c\h\6\4-\2.\1\7.\0-\c\p\3\9-\c\p\3\9-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl + wheel=/tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow_aarch64-2.17.0-cp39-cp39-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp39-cp39-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp39-cp39-manylinux_2_17_aarch64, cp39-cp39-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..5 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 73625ms # Size of /tf/pkg/tensorflow_aarch64-2.17.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 204 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 16ms ok 3 Wheel is installable in 58935ms ok 4 TensorFlow is importable in 4129ms not ok 5 TensorFlow has Keras in 3715ms # (in test file /usertools/wheel_verification.bats, line 72) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "/tf/venv/lib/python3.9/site-packages/tensorflow/python/util/lazy_loader.py", line 147, in _initialize # import keras # pylint: disable=g-import-not-at-top # File "/tf/venv/lib/python3.9/site-packages/keras/__init__.py", line 8, in <module> # from keras import _tf_keras # File "/tf/venv/lib/python3.9/site-packages/keras/_tf_keras/__init__.py", line 1, in <module> # from keras._tf_keras import keras # File "/tf/venv/lib/python3.9/site-packages/keras/_tf_keras/keras/__init__.py", line 61, in <module> # from keras._tf_keras.keras import layers # File "/tf/venv/lib/python3.9/site-packages/keras/_tf_keras/keras/layers/__init__.py", line 148, in <module> # from keras.src.utils.jax_layer import FlaxLayer # File "/tf/venv/lib/python3.9/site-packages/keras/src/utils/jax_layer.py", line 3, in <module> # import jax # ModuleNotFoundError: No module named 'jax' # # During handling of the above exception, another exception occurred: # # Traceback (most recent call last): # File "<string>", line 1, in <module> # File "/tf/venv/lib/python3.9/site-packages/tensorflow/python/util/lazy_loader.py", line 181, in __getattr__ # self._initialize() # File "/tf/venv/lib/python3.9/site-packages/tensorflow/python/util/lazy_loader.py", line 161, in _initialize # raise ImportError( # pylint: disable=raise-missing-from # ImportError: Keras cannot be imported. Check that it is installed. stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=39 changed=26 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0
Thursday 21 March 2024 03:28:56 +0000 (0:05:18.491) 3:18:48.709 ******** =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 7098.93s tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git 3667.77s tensorflow_in_container : (Python 3.9) start build container ---------- 557.88s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 318.49s Cleanup after previous build ------------------------------------------ 195.72s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 35.21s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build -- 19.63s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 4.82s tensorflow_in_container : (Python 3.9) build Python versioned container --- 3.78s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 2.45s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 2.19s Create cache dirs ------------------------------------------------------- 2.12s Gathering Facts --------------------------------------------------------- 2.11s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 1.90s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 1.88s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 1.80s tensorflow : Save git commit hash to file ------------------------------- 1.38s tensorflow_in_container : (Python 3.9) Copy built wheel ----------------- 0.92s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.90s tensorflow : Create linklibs shell script ------------------------------- 0.82s Build step 'Execute shell' marked build as failure
ldcg-ai-ml@op-lists.linaro.org