See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/1091/display/redirect

Changes:

------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/ [ldcg-python-manylinux-tensorflow-nightly] $ /bin/bash /tmp/jenkins10784320398286983631.sh + cd https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/ + rm -rf '*.sh' configs wheels cache_upload + mkdir wheels cache_upload + git clone --depth 1 https://git.linaro.org/ci/job/configs.git Cloning into 'configs'... + cd configs + git log --pretty=oneline -1 cdd5d39f07354926d651895dbc1a7e0c2a2a3fd4 Revert "tcwg_bmk: Disable while result processing is broken" + cd .. + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' true = true ']' + echo ' - "git"' + '[' false = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' false = true ']' + ansible-galaxy collection install community.docker Starting galaxy collection install process Nothing to do. All requested collections are already installed. If you want to reinstall them, consider using `--force`. + cd configs/ldcg-python-manylinux-tensorflow/ansible/ + sed -i -es+/tmp/workspace+https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/+g vars/vars.yml + ansible-playbook playbooks/build-tf-dual-abi.yml [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'

PLAY [Build TensorFlow in Dual ABI container] **********************************

TASK [Gathering Facts] ********************************************************* Monday 26 February 2024 12:28:56 +0000 (0:00:00.047) 0:00:00.047 ******* ok: [localhost]

TASK [Cleanup after previous build] ******************************************** Monday 26 February 2024 12:28:59 +0000 (0:00:02.624) 0:00:02.672 ******* changed: [localhost] => (item=disk-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow)

TASK [Create cache dirs] ******************************************************* Monday 26 February 2024 12:29:34 +0000 (0:00:35.632) 0:00:38.304 ******* changed: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels)

TASK [Set dual abi variable] *************************************************** Monday 26 February 2024 12:29:36 +0000 (0:00:01.464) 0:00:39.768 ******* ok: [localhost]

TASK [Go through each TensorFlow version] ************************************** Monday 26 February 2024 12:29:36 +0000 (0:00:00.035) 0:00:39.803 ******* skipping: [localhost] => (item={'key': '2.16', 'value': {'tensorflow_version': '2.16.0-rc0', 'bazel_version': 'bazelisk', 'flatbuffers_version': 'n/a', 'gast_version': 'n/a', 'grpcio_version': 'n/a', 'h5py_version': 'n/a', 'numpy_version': 'n/a', 'protobuf_version': 'n/a', 'absl_version': 'n/a', 'scipy_version': 'n/a', 'keras_version': 'n/a', 'tensorboard_version': 'n/a', 'tensorflow_estimator_version': 'n/a', 'hermetic_build': True, 'image_prefix': '2.16', 'python_install_packages': 'n/a', 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test', '//tensorflow/compiler/mlir/quantization/tensorflow/debugging:mlir_dump_test'], 'unit_tests_clang_exclude': ['//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11', '3.12']}}) skipping: [localhost] => (item={'key': '2.15', 'value': {'tensorflow_version': '2.15.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': 'n/a', 'gast_version': 'n/a', 'grpcio_version': 'n/a', 'h5py_version': 'n/a', 'numpy_version': 'n/a', 'protobuf_version': 'n/a', 'absl_version': 'n/a', 'scipy_version': 'n/a', 'keras_version': 'n/a', 'tensorboard_version': 'n/a', 'tensorflow_estimator_version': 'n/a', 'hermetic_build': True, 'image_prefix': '2.15', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test'], 'unit_tests_clang_exclude': ['//tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test', '//tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test', '//tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test', '//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.14', 'value': {'tensorflow_version': '2.14.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.5.26', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.14.0', 'tensorboard_version': '==2.14.1', 'tensorflow_estimator_version': '==2.14.0', 'hermetic_build': False, 'image_prefix': '2.14', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/xla/service/gpu:fusion_merger_test', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test'], 'unit_tests_clang_exclude': ['//tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test', '//tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test', '//tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test', '//tensorflow/compiler/xla/service/cpu/tests:cpu_eigen_dot_operation_test', '//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.13', 'value': {'tensorflow_version': '2.13.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.1.21', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.13.1', 'tensorboard_version': '==2.13.0', 'tensorflow_estimator_version': '==2.13.0', 'hermetic_build': False, 'image_prefix': '2.13', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 2.0, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0', 'tensorboard_version': '==2.12.3', 'tensorflow_estimator_version': '==2.12.0', 'hermetic_build': False, 'image_prefix': '2.12', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}})

TASK [tensorflow : Set TensorFlow and other package versions] ****************** Monday 26 February 2024 12:29:36 +0000 (0:00:00.191) 0:00:39.994 ******* ok: [localhost]

TASK [tensorflow : Set build dir for TensorFlow git] *************************** Monday 26 February 2024 12:29:36 +0000 (0:00:00.089) 0:00:40.084 ******* ok: [localhost]

TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Monday 26 February 2024 12:29:36 +0000 (0:00:00.043) 0:00:40.127 ******* changed: [localhost]

TASK [tensorflow : Fetch TensorFlow] ******************************************* Monday 26 February 2024 12:29:40 +0000 (0:00:04.119) 0:00:44.247 ******* included: https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/configs/ldcg-python-manylinux-tensorflow/ansible/roles/tensorflow/tasks/fetch.yml for localhost

TASK [tensorflow : Fetch TensorFlow git source] ******************************** Monday 26 February 2024 12:29:40 +0000 (0:00:00.099) 0:00:44.346 ******* skipping: [localhost]

TASK [tensorflow : Unpack TensorFlow git source] ******************************* Monday 26 February 2024 12:29:40 +0000 (0:00:00.038) 0:00:44.385 ******* skipping: [localhost]

TASK [tensorflow : Rename source dir for oneDNN build] ************************* Monday 26 February 2024 12:29:40 +0000 (0:00:00.036) 0:00:44.421 ******* skipping: [localhost]

TASK [tensorflow : Fetch TensorFlow from git] ********************************** Monday 26 February 2024 12:29:40 +0000 (0:00:00.037) 0:00:44.458 ******* changed: [localhost]

TASK [tensorflow : Fetch TensorFlow from git at commit] ************************ Monday 26 February 2024 12:30:15 +0000 (0:00:34.879) 0:01:19.338 ******* skipping: [localhost]

TASK [tensorflow : Set world write access to source] *************************** Monday 26 February 2024 12:30:15 +0000 (0:00:00.036) 0:01:19.374 ******* changed: [localhost]

TASK [tensorflow : Get oneline version of git log for this checkout] *********** Monday 26 February 2024 12:30:16 +0000 (0:00:00.406) 0:01:19.781 ******* changed: [localhost]

TASK [tensorflow : Show git log] *********************************************** Monday 26 February 2024 12:30:16 +0000 (0:00:00.604) 0:01:20.386 ******* ok: [localhost] => git_log.stdout: de00023b3cc47bda98e5d31fd358330d13c863e4 Clean up includes and build dependencies in stream_executor/host

TASK [tensorflow : Record git commit hash to variable] ************************* Monday 26 February 2024 12:30:16 +0000 (0:00:00.042) 0:01:20.428 ******* ok: [localhost]

TASK [tensorflow : Save git commit hash to file] ******************************* Monday 26 February 2024 12:30:16 +0000 (0:00:00.063) 0:01:20.492 ******* changed: [localhost]

TASK [Build Bazel] ************************************************************* Monday 26 February 2024 12:30:18 +0000 (0:00:01.187) 0:01:21.679 ******* skipping: [localhost]

TASK [Build TensorFlow for each Python version] ******************************** Monday 26 February 2024 12:30:18 +0000 (0:00:00.065) 0:01:21.745 ******* skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) skipping: [localhost] => (item=3.12)

TASK [Build TensorFlow for each Python version (dual abi)] ********************* Monday 26 February 2024 12:30:18 +0000 (0:00:00.053) 0:01:21.799 *******

TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Monday 26 February 2024 12:30:18 +0000 (0:00:00.534) 0:01:22.333 ******* changed: [localhost]

TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Monday 26 February 2024 12:30:19 +0000 (0:00:00.657) 0:01:22.991 ******* skipping: [localhost]

TASK [Fetch TensorFlow] ******************************************************** Monday 26 February 2024 12:30:19 +0000 (0:00:00.033) 0:01:23.025 ******* skipping: [localhost]

TASK [(Python 3.9) patch TensorFlow tree] ************************************** Monday 26 February 2024 12:30:19 +0000 (0:00:00.036) 0:01:23.061 *******

TASK [tensorflow : Create linklibs shell script] ******************************* Monday 26 February 2024 12:30:19 +0000 (0:00:00.125) 0:01:23.187 ******* changed: [localhost]

TASK [tensorflow : Create readme file about unit tests] ************************ Monday 26 February 2024 12:30:20 +0000 (0:00:00.704) 0:01:23.891 ******* changed: [localhost]

TASK [tensorflow : Add to the copied files] ************************************ Monday 26 February 2024 12:30:21 +0000 (0:00:00.703) 0:01:24.595 ******* changed: [localhost]

TASK [tensorflow : Add to the long_description in setup.py] ******************** Monday 26 February 2024 12:30:21 +0000 (0:00:00.591) 0:01:25.187 ******* changed: [localhost]

TASK [tensorflow : Use nightly package requirements] *************************** Monday 26 February 2024 12:30:22 +0000 (0:00:00.587) 0:01:25.774 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for non-hermetic builds] *** Monday 26 February 2024 12:30:22 +0000 (0:00:00.420) 0:01:26.194 ******* skipping: [localhost]

TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] *** Monday 26 February 2024 12:30:22 +0000 (0:00:00.057) 0:01:26.251 ******* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] *** Monday 26 February 2024 12:30:23 +0000 (0:00:00.750) 0:01:27.002 ******* ok: [localhost]

TASK [tensorflow_in_container : (Python 3.9) start build container] ************ Monday 26 February 2024 12:30:25 +0000 (0:00:02.193) 0:01:29.195 ******* fatal: [localhost]: FAILED! => changed=false msg: 'Error creating container: 409 Client Error for http+docker://localhost/v1.41/containers/create?name=tf-py3.9: Conflict ("Conflict. The container name "/tf-py3.9" is already in use by container "170fecebe9b7db3d7f70b77bfe419855e92411c96fe98b0371c61a5a29522e82". You have to remove (or rename) that container to be able to reuse that name.")'

PLAY RECAP ********************************************************************* localhost : ok=22 changed=14 unreachable=0 failed=1 skipped=9 rescued=0 ignored=0

Monday 26 February 2024 12:30:27 +0000 (0:00:01.433) 0:01:30.629 ******* =============================================================================== Cleanup after previous build ------------------------------------------- 35.63s tensorflow : Fetch TensorFlow from git --------------------------------- 34.88s tensorflow : Remove TensorFlow git sources from previous build ---------- 4.12s Gathering Facts --------------------------------------------------------- 2.62s tensorflow_in_container : (Python 3.9) build Python versioned container --- 2.19s Create cache dirs ------------------------------------------------------- 1.46s tensorflow_in_container : (Python 3.9) start build container ------------ 1.43s tensorflow : Save git commit hash to file ------------------------------- 1.19s tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.75s tensorflow : Create linklibs shell script ------------------------------- 0.70s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow_in_container : Reset checkout to clean state ----------------- 0.66s tensorflow : Get oneline version of git log for this checkout ----------- 0.60s tensorflow : Add to the copied files ------------------------------------ 0.59s tensorflow : Add to the long_description in setup.py -------------------- 0.59s Build TensorFlow for each Python version (dual abi) --------------------- 0.53s tensorflow : Use nightly package requirements --------------------------- 0.42s tensorflow : Set world write access to source --------------------------- 0.41s Go through each TensorFlow version -------------------------------------- 0.19s (Python 3.9) patch TensorFlow tree -------------------------------------- 0.13s Build step 'Execute shell' marked build as failure