See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/1101/display/redirect

Changes:

------------------------------------------ [...truncated 2.61 KB...] TASK [Set dual abi variable] *************************************************** Wednesday 06 March 2024 18:10:39 +0000 (0:00:01.421) 0:00:34.975 ******* ok: [localhost]

TASK [Go through each TensorFlow version] ************************************** Wednesday 06 March 2024 18:10:39 +0000 (0:00:00.033) 0:00:35.008 ******* skipping: [localhost] => (item={'key': '2.16', 'value': {'tensorflow_version': '2.16.0-rc0', 'bazel_version': 'bazelisk', 'flatbuffers_version': 'n/a', 'gast_version': 'n/a', 'grpcio_version': 'n/a', 'h5py_version': 'n/a', 'numpy_version': 'n/a', 'protobuf_version': 'n/a', 'absl_version': 'n/a', 'scipy_version': 'n/a', 'keras_version': 'n/a', 'tensorboard_version': 'n/a', 'tensorflow_estimator_version': 'n/a', 'hermetic_build': True, 'image_prefix': '2.16', 'python_install_packages': 'n/a', 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test', '//tensorflow/compiler/mlir/quantization/tensorflow/debugging:mlir_dump_test'], 'unit_tests_clang_exclude': ['//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11', '3.12']}}) skipping: [localhost] => (item={'key': '2.15', 'value': {'tensorflow_version': '2.15.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': 'n/a', 'gast_version': 'n/a', 'grpcio_version': 'n/a', 'h5py_version': 'n/a', 'numpy_version': 'n/a', 'protobuf_version': 'n/a', 'absl_version': 'n/a', 'scipy_version': 'n/a', 'keras_version': 'n/a', 'tensorboard_version': 'n/a', 'tensorflow_estimator_version': 'n/a', 'hermetic_build': True, 'image_prefix': '2.15', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test'], 'unit_tests_clang_exclude': ['//tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test', '//tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test', '//tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test', '//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.14', 'value': {'tensorflow_version': '2.14.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.5.26', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.14.0', 'tensorboard_version': '==2.14.1', 'tensorflow_estimator_version': '==2.14.0', 'hermetic_build': False, 'image_prefix': '2.14', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/xla/service/gpu:fusion_merger_test', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test'], 'unit_tests_clang_exclude': ['//tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test', '//tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test', '//tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test', '//tensorflow/compiler/xla/service/cpu/tests:cpu_eigen_dot_operation_test', '//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.13', 'value': {'tensorflow_version': '2.13.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.1.21', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.13.1', 'tensorboard_version': '==2.13.0', 'tensorflow_estimator_version': '==2.13.0', 'hermetic_build': False, 'image_prefix': '2.13', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 2.0, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0', 'tensorboard_version': '==2.12.3', 'tensorflow_estimator_version': '==2.12.0', 'hermetic_build': False, 'image_prefix': '2.12', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}})

TASK [tensorflow : Set TensorFlow and other package versions] ****************** Wednesday 06 March 2024 18:10:39 +0000 (0:00:00.189) 0:00:35.198 ******* ok: [localhost]

TASK [tensorflow : Set build dir for TensorFlow git] *************************** Wednesday 06 March 2024 18:10:39 +0000 (0:00:00.087) 0:00:35.285 ******* ok: [localhost]

TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Wednesday 06 March 2024 18:10:39 +0000 (0:00:00.043) 0:00:35.328 ******* changed: [localhost]

TASK [tensorflow : Fetch TensorFlow] ******************************************* Wednesday 06 March 2024 18:10:43 +0000 (0:00:04.085) 0:00:39.414 ******* included: https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/configs/ldcg-python-manylinux-tensorflow/ansible/roles/tensorflow/tasks/fetch.yml for localhost

TASK [tensorflow : Fetch TensorFlow git source] ******************************** Wednesday 06 March 2024 18:10:43 +0000 (0:00:00.097) 0:00:39.512 ******* skipping: [localhost]

TASK [tensorflow : Unpack TensorFlow git source] ******************************* Wednesday 06 March 2024 18:10:43 +0000 (0:00:00.036) 0:00:39.549 ******* skipping: [localhost]

TASK [tensorflow : Rename source dir for oneDNN build] ************************* Wednesday 06 March 2024 18:10:43 +0000 (0:00:00.034) 0:00:39.583 ******* skipping: [localhost]

TASK [tensorflow : Fetch TensorFlow from git] ********************************** Wednesday 06 March 2024 18:10:43 +0000 (0:00:00.036) 0:00:39.620 ******* changed: [localhost]

TASK [tensorflow : Fetch TensorFlow from git at commit] ************************ Wednesday 06 March 2024 18:11:06 +0000 (0:00:22.523) 0:01:02.143 ******* skipping: [localhost]

TASK [tensorflow : Set world write access to source] *************************** Wednesday 06 March 2024 18:11:06 +0000 (0:00:00.033) 0:01:02.177 ******* changed: [localhost]

TASK [tensorflow : Get oneline version of git log for this checkout] *********** Wednesday 06 March 2024 18:11:06 +0000 (0:00:00.371) 0:01:02.548 ******* changed: [localhost]

TASK [tensorflow : Show git log] *********************************************** Wednesday 06 March 2024 18:11:07 +0000 (0:00:00.584) 0:01:03.133 ******* ok: [localhost] => git_log.stdout: ee608086f94326a42c95ac7af884a86387b38b8c Update TFRT dependency to use revision http://github.com/tensorflow/runtime/commit/60cf2ee058a43b5c237aecd8ea257ed4....

TASK [tensorflow : Record git commit hash to variable] ************************* Wednesday 06 March 2024 18:11:07 +0000 (0:00:00.040) 0:01:03.174 ******* ok: [localhost]

TASK [tensorflow : Save git commit hash to file] ******************************* Wednesday 06 March 2024 18:11:07 +0000 (0:00:00.058) 0:01:03.232 ******* changed: [localhost]

TASK [Build Bazel] ************************************************************* Wednesday 06 March 2024 18:11:08 +0000 (0:00:01.148) 0:01:04.381 ******* skipping: [localhost]

TASK [Build TensorFlow for each Python version] ******************************** Wednesday 06 March 2024 18:11:08 +0000 (0:00:00.033) 0:01:04.415 ******* skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) skipping: [localhost] => (item=3.12)

TASK [Build TensorFlow for each Python version (dual abi)] ********************* Wednesday 06 March 2024 18:11:08 +0000 (0:00:00.052) 0:01:04.467 *******

TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Wednesday 06 March 2024 18:11:09 +0000 (0:00:00.530) 0:01:04.998 ******* changed: [localhost]

TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Wednesday 06 March 2024 18:11:09 +0000 (0:00:00.648) 0:01:05.647 ******* skipping: [localhost]

TASK [Fetch TensorFlow] ******************************************************** Wednesday 06 March 2024 18:11:09 +0000 (0:00:00.034) 0:01:05.681 ******* skipping: [localhost]

TASK [(Python 3.9) patch TensorFlow tree] ************************************** Wednesday 06 March 2024 18:11:09 +0000 (0:00:00.034) 0:01:05.716 *******

TASK [tensorflow : Create linklibs shell script] ******************************* Wednesday 06 March 2024 18:11:10 +0000 (0:00:00.126) 0:01:05.842 ******* changed: [localhost]

TASK [tensorflow : Create readme file about unit tests] ************************ Wednesday 06 March 2024 18:11:10 +0000 (0:00:00.688) 0:01:06.531 ******* changed: [localhost]

TASK [tensorflow : Add to the copied files] ************************************ Wednesday 06 March 2024 18:11:11 +0000 (0:00:00.695) 0:01:07.226 ******* changed: [localhost]

TASK [tensorflow : Add to the long_description in setup.py] ******************** Wednesday 06 March 2024 18:11:12 +0000 (0:00:00.587) 0:01:07.814 ******* changed: [localhost]

TASK [tensorflow : Use nightly package requirements] *************************** Wednesday 06 March 2024 18:11:12 +0000 (0:00:00.577) 0:01:08.392 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for non-hermetic builds] *** Wednesday 06 March 2024 18:11:13 +0000 (0:00:00.403) 0:01:08.795 ******* skipping: [localhost]

TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] *** Wednesday 06 March 2024 18:11:13 +0000 (0:00:00.055) 0:01:08.851 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] *** Wednesday 06 March 2024 18:11:13 +0000 (0:00:00.688) 0:01:09.539 ******* ok: [localhost]

TASK [tensorflow_in_container : (Python 3.9) start build container] ************ Wednesday 06 March 2024 18:11:15 +0000 (0:00:01.460) 0:01:11.000 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] *** Wednesday 06 March 2024 18:11:22 +0000 (0:00:07.192) 0:01:18.193 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ****** Wednesday 06 March 2024 18:11:23 +0000 (0:00:01.249) 0:01:19.442 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] *** Wednesday 06 March 2024 18:11:24 +0000 (0:00:00.879) 0:01:20.321 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ******** Wednesday 06 March 2024 18:11:25 +0000 (0:00:00.837) 0:01:21.158 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] *** Wednesday 06 March 2024 18:11:26 +0000 (0:00:00.843) 0:01:22.002 ******* changed: [localhost]

TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Wednesday 06 March 2024 18:11:28 +0000 (0:00:02.044) 0:01:24.046 ******* ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ------------------- -------------------- -------------------------------------- --------- auditwheel 5.4.0 /usr/local/lib/python3.9/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.16.0 /usr/local/lib/python3.9/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages cryptography 42.0.2 /usr/local/lib/python3.9/dist-packages pip Cython 3.0.8 /usr/local/lib/python3.9/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 7.0.1 /usr/local/lib/python3.9/dist-packages pip jaraco.classes 3.3.1 /usr/local/lib/python3.9/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip keyring 24.3.0 /usr/local/lib/python3.9/dist-packages pip markdown-it-py 3.0.0 /usr/local/lib/python3.9/dist-packages pip mdurl 0.1.2 /usr/local/lib/python3.9/dist-packages pip more-itertools 10.2.0 /usr/local/lib/python3.9/dist-packages pip nh3 0.2.15 /usr/local/lib/python3.9/dist-packages pip pip 24.0 /usr/local/lib/python3.9/dist-packages pip pkginfo 1.9.6 /usr/local/lib/python3.9/dist-packages pip portpicker 1.6.0 /usr/local/lib/python3.9/dist-packages pip psutil 5.9.8 /usr/local/lib/python3.9/dist-packages pip pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip pyelftools 0.30 /usr/local/lib/python3.9/dist-packages pip Pygments 2.17.2 /usr/local/lib/python3.9/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages readme-renderer 42.0 /usr/local/lib/python3.9/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip rich 13.7.0 /usr/local/lib/python3.9/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip setuptools 69.1.0 /usr/local/lib/python3.9/dist-packages pip six 1.14.0 /usr/lib/python3/dist-packages twine 4.0.2 /usr/local/lib/python3.9/dist-packages pip urllib3 2.2.0 /usr/local/lib/python3.9/dist-packages pip wheel 0.42.0 /usr/local/lib/python3.9/dist-packages pip zipp 3.17.0 /usr/local/lib/python3.9/dist-packages pip

TASK [tensorflow_in_container : (Python 3.9) build TensorFlow git] ************* Wednesday 06 March 2024 18:11:28 +0000 (0:00:00.042) 0:01:24.089 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) build Python package] ************* Wednesday 06 March 2024 19:12:23 +0000 (1:00:54.924) 1:02:19.013 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: 'chmod: cannot access ''/tmp/tmp.d1JRN0CCms/tensorflow/compiler/mlir/quantization/tensorflow/calibrator/pywrap_calibration.so'': No such file or directory' stderr_lines: <omitted> stdout: |- TensorFlow Version: 2.17.0 TensorFlow Major Version: 2 TMPDIR: /tmp/tmp.d1JRN0CCms Wed Mar 6 19:12:24 UTC 2024 : === Preparing sources in dir: /tmp/tmp.d1JRN0CCms /tf/tensorflow /tf/tensorflow /tf/tensorflow /tf/tensorflow /tf/tensorflow /tf/tensorflow /tf/tensorflow/bazel-bin/tensorflow/tools/pip_package/build_pip_package.runfiles/org_tensorflow /tf/tensorflow /tf/tensorflow stdout_lines: <omitted>

PLAY RECAP ********************************************************************* localhost : ok=30 changed=21 unreachable=0 failed=1 skipped=9 rescued=0 ignored=0

Wednesday 06 March 2024 19:12:43 +0000 (0:00:19.810) 1:02:38.824 ******* =============================================================================== tensorflow_in_container : (Python 3.9) build TensorFlow git ---------- 3654.92s Cleanup after previous build ------------------------------------------- 30.87s tensorflow : Fetch TensorFlow from git --------------------------------- 22.52s tensorflow_in_container : (Python 3.9) build Python package ------------ 19.81s tensorflow_in_container : (Python 3.9) start build container ------------ 7.19s tensorflow : Remove TensorFlow git sources from previous build ---------- 4.09s Gathering Facts --------------------------------------------------------- 2.63s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 2.04s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.46s Create cache dirs ------------------------------------------------------- 1.42s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.25s tensorflow : Save git commit hash to file ------------------------------- 1.15s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.88s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.84s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.84s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.69s tensorflow_in_container : Reset checkout to clean state ----------------- 0.65s tensorflow : Add to the copied files ------------------------------------ 0.59s Build step 'Execute shell' marked build as failure