See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/848/display/redirect
Changes:
------------------------------------------ [...truncated 1.49 MB...] //tensorflow/python/saved_model:load_test_cpu PASSED in 62.3s Stats over 10 runs: max = 62.3s, min = 39.2s, avg = 45.1s, dev = 6.1s //tensorflow/compiler/tests:fft_test_cpu PASSED in 26.2s Stats over 12 runs: max = 26.2s, min = 7.8s, avg = 16.9s, dev = 6.9s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 5.0s Stats over 12 runs: max = 5.0s, min = 2.3s, avg = 3.3s, dev = 0.7s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 14.4s Stats over 12 runs: max = 14.4s, min = 3.2s, avg = 8.7s, dev = 3.6s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 13.4s Stats over 12 runs: max = 13.4s, min = 6.7s, avg = 9.1s, dev = 2.0s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 11.8s Stats over 12 runs: max = 11.8s, min = 6.4s, avg = 9.2s, dev = 1.6s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 231.3s Stats over 12 runs: max = 231.3s, min = 19.8s, avg = 57.6s, dev = 58.3s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 228.9s Stats over 12 runs: max = 228.9s, min = 16.5s, avg = 55.2s, dev = 58.4s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 23.1s Stats over 15 runs: max = 23.1s, min = 14.6s, avg = 18.6s, dev = 2.0s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 72.4s Stats over 15 runs: max = 72.4s, min = 62.4s, avg = 68.3s, dev = 3.2s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 54.8s Stats over 15 runs: max = 54.8s, min = 12.0s, avg = 18.2s, dev = 10.6s //tensorflow/compiler/tests:ftrl_test_cpu PASSED in 11.4s Stats over 16 runs: max = 11.4s, min = 5.5s, avg = 7.8s, dev = 2.1s //tensorflow/compiler/tests:ternary_ops_test_cpu PASSED in 12.3s Stats over 16 runs: max = 12.3s, min = 5.3s, avg = 9.6s, dev = 2.4s //tensorflow/compiler/tests:ternary_ops_test_cpu_mlir_bridge_test PASSED in 12.8s Stats over 16 runs: max = 12.8s, min = 6.5s, avg = 8.8s, dev = 1.7s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 14.3s Stats over 16 runs: max = 14.3s, min = 5.1s, avg = 10.3s, dev = 2.8s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 19.4s Stats over 16 runs: max = 19.4s, min = 3.8s, avg = 11.4s, dev = 4.8s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 30.2s Stats over 16 runs: max = 30.2s, min = 13.4s, avg = 20.3s, dev = 4.4s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 24.0s Stats over 16 runs: max = 24.0s, min = 5.5s, avg = 10.2s, dev = 4.0s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 10.5s Stats over 16 runs: max = 10.5s, min = 4.3s, avg = 6.9s, dev = 2.1s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 18.3s Stats over 16 runs: max = 18.3s, min = 8.5s, avg = 11.9s, dev = 2.6s //tensorflow/python/ops:image_ops_test_cpu PASSED in 25.8s Stats over 16 runs: max = 25.8s, min = 12.0s, avg = 17.4s, dev = 3.5s //tensorflow/python/data/experimental/kernel_tests/service:distributed_save_ft_test PASSED in 52.9s Stats over 17 runs: max = 52.9s, min = 4.4s, avg = 19.0s, dev = 17.8s //tensorflow/python/data/kernel_tests:map_test PASSED in 48.7s Stats over 19 runs: max = 48.7s, min = 19.3s, avg = 32.5s, dev = 9.5s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 9.2s Stats over 20 runs: max = 9.2s, min = 4.0s, avg = 5.8s, dev = 1.8s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 9.2s Stats over 20 runs: max = 9.2s, min = 6.2s, avg = 7.9s, dev = 0.9s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 11.8s Stats over 20 runs: max = 11.8s, min = 3.8s, avg = 6.8s, dev = 2.3s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 13.0s Stats over 20 runs: max = 13.0s, min = 3.2s, avg = 6.8s, dev = 2.4s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 7.9s Stats over 20 runs: max = 7.9s, min = 6.7s, avg = 7.5s, dev = 0.4s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 14.8s Stats over 20 runs: max = 14.8s, min = 10.9s, avg = 12.2s, dev = 0.9s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 12.9s Stats over 20 runs: max = 12.9s, min = 10.6s, avg = 11.5s, dev = 0.6s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 8.0s Stats over 20 runs: max = 8.0s, min = 6.9s, avg = 7.3s, dev = 0.2s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 37.7s Stats over 20 runs: max = 37.7s, min = 7.2s, avg = 15.0s, dev = 9.5s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 26.1s Stats over 20 runs: max = 26.1s, min = 19.8s, avg = 23.3s, dev = 1.6s //tensorflow/python/kernel_tests:metrics_test PASSED in 40.8s Stats over 20 runs: max = 40.8s, min = 10.7s, avg = 20.1s, dev = 8.8s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 9.3s Stats over 20 runs: max = 9.3s, min = 4.0s, avg = 7.0s, dev = 1.9s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 11.2s Stats over 20 runs: max = 11.2s, min = 3.6s, avg = 8.1s, dev = 2.3s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 43.3s Stats over 20 runs: max = 43.3s, min = 7.2s, avg = 16.4s, dev = 11.8s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 117.7s Stats over 20 runs: max = 117.7s, min = 39.9s, avg = 63.8s, dev = 21.5s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 9.9s Stats over 20 runs: max = 9.9s, min = 4.1s, avg = 5.9s, dev = 1.6s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 15.7s Stats over 20 runs: max = 15.7s, min = 6.0s, avg = 10.1s, dev = 2.8s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 206.4s Stats over 20 runs: max = 206.4s, min = 35.6s, avg = 94.5s, dev = 54.5s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 25.8s Stats over 20 runs: max = 25.8s, min = 12.7s, avg = 17.0s, dev = 4.6s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 25.2s Stats over 20 runs: max = 25.2s, min = 7.5s, avg = 15.7s, dev = 5.7s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 20.8s Stats over 20 runs: max = 20.8s, min = 13.1s, avg = 16.2s, dev = 2.2s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 65.0s Stats over 20 runs: max = 65.0s, min = 11.5s, avg = 30.6s, dev = 18.7s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 22.7s Stats over 20 runs: max = 22.7s, min = 10.0s, avg = 13.6s, dev = 2.7s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 18.5s Stats over 24 runs: max = 18.5s, min = 8.0s, avg = 14.2s, dev = 2.6s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 21.8s Stats over 24 runs: max = 21.8s, min = 7.9s, avg = 13.9s, dev = 3.9s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 17.8s Stats over 24 runs: max = 17.8s, min = 3.5s, avg = 8.2s, dev = 3.9s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 9.9s Stats over 25 runs: max = 9.9s, min = 8.3s, avg = 9.3s, dev = 0.4s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 37.9s Stats over 25 runs: max = 37.9s, min = 8.4s, avg = 13.0s, dev = 7.4s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 15.2s Stats over 30 runs: max = 15.2s, min = 7.4s, avg = 9.7s, dev = 2.0s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 13.2s Stats over 30 runs: max = 13.2s, min = 12.3s, avg = 12.6s, dev = 0.2s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 9.6s Stats over 30 runs: max = 9.6s, min = 7.4s, avg = 8.7s, dev = 0.8s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 10.2s Stats over 30 runs: max = 10.2s, min = 8.7s, avg = 9.6s, dev = 0.3s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 20.0s Stats over 30 runs: max = 20.0s, min = 3.7s, avg = 8.6s, dev = 3.5s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 10.4s Stats over 31 runs: max = 10.4s, min = 9.0s, avg = 9.8s, dev = 0.3s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 11.4s Stats over 32 runs: max = 11.4s, min = 7.0s, avg = 8.5s, dev = 1.1s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 22.2s Stats over 32 runs: max = 22.2s, min = 3.5s, avg = 9.4s, dev = 4.5s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 16.2s Stats over 40 runs: max = 16.2s, min = 8.8s, avg = 11.2s, dev = 1.8s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 9.6s Stats over 40 runs: max = 9.6s, min = 7.3s, avg = 8.3s, dev = 0.6s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 16.5s Stats over 40 runs: max = 16.5s, min = 10.4s, avg = 12.1s, dev = 1.4s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 10.7s Stats over 40 runs: max = 10.7s, min = 7.9s, avg = 9.0s, dev = 0.6s //tensorflow/core/kernels:stochastic_cast_op_test PASSED in 1.5s Stats over 48 runs: max = 1.5s, min = 0.4s, avg = 0.5s, dev = 0.2s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 76.0s Stats over 50 runs: max = 76.0s, min = 27.2s, avg = 43.3s, dev = 12.1s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 39.4s Stats over 50 runs: max = 39.4s, min = 3.3s, avg = 11.5s, dev = 7.6s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 35.9s Stats over 50 runs: max = 35.9s, min = 3.4s, avg = 10.8s, dev = 7.2s //tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 20.8s Stats over 50 runs: max = 20.8s, min = 3.3s, avg = 6.0s, dev = 3.7s //tensorflow/compiler/tests:unary_ops_test_cpu_mlir_bridge_test PASSED in 24.1s Stats over 50 runs: max = 24.1s, min = 3.5s, avg = 6.1s, dev = 4.0s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 11.7s Stats over 50 runs: max = 11.7s, min = 8.1s, avg = 9.8s, dev = 0.9s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 13.8s Stats over 50 runs: max = 13.8s, min = 9.2s, avg = 12.3s, dev = 1.1s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 17.8s Stats over 50 runs: max = 17.8s, min = 12.7s, avg = 14.8s, dev = 1.2s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 17.6s Stats over 50 runs: max = 17.6s, min = 5.6s, avg = 10.2s, dev = 2.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 10.6s Stats over 50 runs: max = 10.6s, min = 3.7s, avg = 5.2s, dev = 1.8s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 10.2s Stats over 50 runs: max = 10.2s, min = 4.1s, avg = 6.0s, dev = 1.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 28.5s Stats over 50 runs: max = 28.5s, min = 8.1s, avg = 15.8s, dev = 5.0s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 13.2s Stats over 50 runs: max = 13.2s, min = 3.7s, avg = 7.5s, dev = 3.4s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 16.4s Stats over 50 runs: max = 16.4s, min = 3.6s, avg = 6.6s, dev = 2.8s
Executed 3791 out of 3792 tests: 3790 tests pass, 1 fails to build and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Friday 07 July 2023 22:27:38 +0100 (2:14:04.996) 3:17:33.104 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Friday 07 July 2023 22:27:40 +0100 (0:00:02.092) 3:17:35.197 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Friday 07 July 2023 22:27:40 +0100 (0:00:00.689) 3:17:35.886 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Friday 07 July 2023 22:27:41 +0100 (0:00:00.697) 3:17:36.584 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Friday 07 July 2023 22:27:42 +0100 (0:00:00.704) 3:17:37.288 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Friday 07 July 2023 22:27:42 +0100 (0:00:00.078) 3:17:37.367 *********** ok: [localhost] => ut_tests_line: 'Executed 3791 out of 3792 tests: 3790 tests pass, 1 fails to build and 1 fails locally.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Friday 07 July 2023 22:27:42 +0100 (0:00:00.042) 3:17:37.409 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Friday 07 July 2023 22:27:42 +0100 (0:00:00.070) 3:17:37.480 *********** ok: [localhost] => tests_failed: - 'FAILED: //tensorflow/compiler/xla/service/gpu:fusion_merger_test (Summary)' - 'FAILED: Build did NOT complete successfully'
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Friday 07 July 2023 22:27:42 +0100 (0:00:00.041) 3:17:37.521 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get list of wheel files] ********** Friday 07 July 2023 22:32:13 +0100 (0:04:31.199) 3:22:08.721 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get filename of latest wheel] ***** Friday 07 July 2023 22:32:14 +0100 (0:00:00.599) 3:22:09.320 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside] *** Friday 07 July 2023 22:32:14 +0100 (0:00:00.063) 3:22:09.384 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Remove manylinux2014 wheel] ******* Friday 07 July 2023 22:32:16 +0100 (0:00:02.425) 3:22:11.809 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) stop build container] ************* Friday 07 July 2023 22:32:17 +0100 (0:00:00.376) 3:22:12.185 *********** fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container 8449318d4f44e9deadb5880af1fcd660cf2d67a38d120a57ba5fa3ba893256eb: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=600)'
PLAY RECAP ********************************************************************* localhost : ok=47 changed=32 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Friday 07 July 2023 22:42:42 +0100 (0:10:25.784) 3:32:37.970 *********** =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 8045.00s tensorflow_in_container : (Python 3.9) build TensorFlow git ---------- 3613.69s tensorflow_in_container : (Python 3.9) stop build container ----------- 625.78s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 271.20s tensorflow_in_container : (Python 3.9) build Python package ----------- 110.50s Cleanup after previous build ------------------------------------------- 31.51s tensorflow : Fetch TensorFlow from git --------------------------------- 22.61s tensorflow_in_container : (Python 3.9) start build container ------------ 4.42s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.98s Gathering Facts --------------------------------------------------------- 2.65s tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside --- 2.43s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 2.27s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 2.09s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.88s Create cache dirs ------------------------------------------------------- 1.44s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.26s tensorflow : Save git commit hash to file ------------------------------- 1.15s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.90s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.85s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.84s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/849/display/redirect
Changes:
------------------------------------------ [...truncated 1.47 MB...] //tensorflow/python/saved_model:load_test_cpu PASSED in 58.7s Stats over 10 runs: max = 58.7s, min = 32.1s, avg = 39.0s, dev = 7.1s //tensorflow/compiler/tests:fft_test_cpu PASSED in 29.6s Stats over 12 runs: max = 29.6s, min = 12.3s, avg = 19.7s, dev = 6.2s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 5.4s Stats over 12 runs: max = 5.4s, min = 2.9s, avg = 3.7s, dev = 0.7s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 15.8s Stats over 12 runs: max = 15.8s, min = 4.3s, avg = 10.4s, dev = 3.8s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 13.5s Stats over 12 runs: max = 13.5s, min = 8.7s, avg = 10.3s, dev = 1.4s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 12.5s Stats over 12 runs: max = 12.5s, min = 8.2s, avg = 9.8s, dev = 1.2s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 223.2s Stats over 12 runs: max = 223.2s, min = 13.8s, avg = 50.3s, dev = 57.8s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 227.3s Stats over 12 runs: max = 227.3s, min = 16.3s, avg = 53.2s, dev = 58.4s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 33.1s Stats over 15 runs: max = 33.1s, min = 17.5s, avg = 24.9s, dev = 3.7s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 88.6s Stats over 15 runs: max = 88.6s, min = 72.5s, avg = 79.1s, dev = 4.8s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 49.2s Stats over 15 runs: max = 49.2s, min = 5.9s, avg = 15.2s, dev = 10.4s //tensorflow/compiler/tests:ftrl_test_cpu PASSED in 10.4s Stats over 16 runs: max = 10.4s, min = 4.1s, avg = 7.5s, dev = 1.8s //tensorflow/compiler/tests:ternary_ops_test_cpu PASSED in 15.8s Stats over 16 runs: max = 15.8s, min = 6.4s, avg = 11.2s, dev = 2.4s //tensorflow/compiler/tests:ternary_ops_test_cpu_mlir_bridge_test PASSED in 14.2s Stats over 16 runs: max = 14.2s, min = 5.3s, avg = 9.5s, dev = 2.4s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 14.9s Stats over 16 runs: max = 14.9s, min = 5.7s, avg = 10.6s, dev = 2.7s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 27.5s Stats over 16 runs: max = 27.5s, min = 4.5s, avg = 15.6s, dev = 6.1s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 29.1s Stats over 16 runs: max = 29.1s, min = 10.8s, avg = 17.6s, dev = 5.3s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 33.6s Stats over 16 runs: max = 33.6s, min = 12.7s, avg = 15.7s, dev = 4.7s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 10.8s Stats over 16 runs: max = 10.8s, min = 4.4s, avg = 6.3s, dev = 1.9s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 14.1s Stats over 16 runs: max = 14.1s, min = 9.2s, avg = 11.7s, dev = 1.7s //tensorflow/python/ops:image_ops_test_cpu PASSED in 20.1s Stats over 16 runs: max = 20.1s, min = 10.2s, avg = 15.1s, dev = 2.6s //tensorflow/python/data/experimental/kernel_tests/service:distributed_save_ft_test PASSED in 49.9s Stats over 17 runs: max = 49.9s, min = 6.3s, avg = 18.0s, dev = 15.9s //tensorflow/python/data/kernel_tests:map_test PASSED in 58.6s Stats over 19 runs: max = 58.6s, min = 15.3s, avg = 22.7s, dev = 9.1s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 10.5s Stats over 20 runs: max = 10.5s, min = 4.0s, avg = 6.9s, dev = 1.8s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 12.3s Stats over 20 runs: max = 12.3s, min = 10.1s, avg = 11.3s, dev = 0.6s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 13.7s Stats over 20 runs: max = 13.7s, min = 3.6s, avg = 6.7s, dev = 2.7s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 13.3s Stats over 20 runs: max = 13.3s, min = 4.4s, avg = 7.1s, dev = 1.9s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 7.7s Stats over 20 runs: max = 7.7s, min = 6.7s, avg = 7.2s, dev = 0.3s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.5s Stats over 20 runs: max = 13.5s, min = 11.0s, avg = 12.1s, dev = 0.7s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 12.7s Stats over 20 runs: max = 12.7s, min = 11.1s, avg = 11.9s, dev = 0.5s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 12.8s Stats over 20 runs: max = 12.8s, min = 8.1s, avg = 9.4s, dev = 1.1s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 43.4s Stats over 20 runs: max = 43.4s, min = 9.7s, avg = 18.9s, dev = 10.6s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 27.2s Stats over 20 runs: max = 27.2s, min = 17.2s, avg = 22.4s, dev = 3.5s //tensorflow/python/kernel_tests:metrics_test PASSED in 38.2s Stats over 20 runs: max = 38.2s, min = 6.9s, avg = 17.8s, dev = 9.2s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 9.5s Stats over 20 runs: max = 9.5s, min = 3.6s, avg = 6.0s, dev = 2.1s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 13.8s Stats over 20 runs: max = 13.8s, min = 4.0s, avg = 8.5s, dev = 3.1s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 47.0s Stats over 20 runs: max = 47.0s, min = 4.3s, avg = 15.5s, dev = 13.3s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 96.1s Stats over 20 runs: max = 96.1s, min = 25.6s, avg = 48.3s, dev = 18.3s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 9.8s Stats over 20 runs: max = 9.8s, min = 4.7s, avg = 6.3s, dev = 1.9s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 17.8s Stats over 20 runs: max = 17.8s, min = 7.0s, avg = 12.3s, dev = 3.6s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 198.4s Stats over 20 runs: max = 198.4s, min = 36.6s, avg = 98.6s, dev = 48.8s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 28.2s Stats over 20 runs: max = 28.2s, min = 5.0s, avg = 14.1s, dev = 6.7s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 25.9s Stats over 20 runs: max = 25.9s, min = 9.2s, avg = 16.7s, dev = 6.1s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 19.0s Stats over 20 runs: max = 19.0s, min = 13.0s, avg = 16.1s, dev = 2.1s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 61.2s Stats over 20 runs: max = 61.2s, min = 4.7s, avg = 25.4s, dev = 18.9s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 23.0s Stats over 20 runs: max = 23.0s, min = 10.8s, avg = 13.5s, dev = 3.0s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 21.5s Stats over 24 runs: max = 21.5s, min = 7.3s, avg = 16.2s, dev = 4.0s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 27.8s Stats over 24 runs: max = 27.8s, min = 7.8s, avg = 16.1s, dev = 6.0s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 20.2s Stats over 24 runs: max = 20.2s, min = 4.4s, avg = 10.2s, dev = 4.1s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 8.9s Stats over 25 runs: max = 8.9s, min = 7.3s, avg = 7.9s, dev = 0.4s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 33.8s Stats over 25 runs: max = 33.8s, min = 7.2s, avg = 11.0s, dev = 6.8s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 8.7s Stats over 30 runs: max = 8.7s, min = 7.1s, avg = 7.8s, dev = 0.5s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 14.4s Stats over 30 runs: max = 14.4s, min = 12.7s, avg = 13.5s, dev = 0.4s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 9.5s Stats over 30 runs: max = 9.5s, min = 7.7s, avg = 8.5s, dev = 0.4s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 8.8s Stats over 30 runs: max = 8.8s, min = 7.4s, avg = 8.1s, dev = 0.4s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 15.2s Stats over 30 runs: max = 15.2s, min = 6.1s, avg = 9.5s, dev = 2.4s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 12.3s Stats over 31 runs: max = 12.3s, min = 9.1s, avg = 10.7s, dev = 0.8s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 9.8s Stats over 32 runs: max = 9.8s, min = 7.7s, avg = 8.6s, dev = 0.5s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 18.9s Stats over 32 runs: max = 18.9s, min = 4.3s, avg = 8.5s, dev = 3.6s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 11.2s Stats over 40 runs: max = 11.2s, min = 7.9s, avg = 9.7s, dev = 1.0s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 12.5s Stats over 40 runs: max = 12.5s, min = 7.3s, avg = 10.8s, dev = 1.3s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 12.5s Stats over 40 runs: max = 12.5s, min = 9.2s, avg = 10.6s, dev = 1.1s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 12.0s Stats over 40 runs: max = 12.0s, min = 7.8s, avg = 8.9s, dev = 0.7s //tensorflow/core/kernels:stochastic_cast_op_test PASSED in 1.5s Stats over 48 runs: max = 1.5s, min = 0.4s, avg = 0.6s, dev = 0.3s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 53.3s Stats over 50 runs: max = 53.3s, min = 21.1s, avg = 36.0s, dev = 7.4s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 34.2s Stats over 50 runs: max = 34.2s, min = 3.6s, avg = 10.9s, dev = 6.4s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 40.1s Stats over 50 runs: max = 40.1s, min = 3.4s, avg = 10.6s, dev = 7.9s //tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 13.9s Stats over 50 runs: max = 13.9s, min = 3.3s, avg = 6.9s, dev = 2.8s //tensorflow/compiler/tests:unary_ops_test_cpu_mlir_bridge_test PASSED in 24.1s Stats over 50 runs: max = 24.1s, min = 3.4s, avg = 6.5s, dev = 4.2s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 10.7s Stats over 50 runs: max = 10.7s, min = 7.7s, avg = 8.6s, dev = 0.6s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 16.4s Stats over 50 runs: max = 16.4s, min = 8.0s, avg = 14.7s, dev = 2.4s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 14.7s Stats over 50 runs: max = 14.7s, min = 9.7s, avg = 11.7s, dev = 1.3s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 14.8s Stats over 50 runs: max = 14.8s, min = 5.7s, avg = 9.2s, dev = 2.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 10.2s Stats over 50 runs: max = 10.2s, min = 3.5s, avg = 5.4s, dev = 1.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 10.4s Stats over 50 runs: max = 10.4s, min = 3.7s, avg = 5.2s, dev = 1.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 29.6s Stats over 50 runs: max = 29.6s, min = 8.0s, avg = 14.9s, dev = 5.4s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 14.8s Stats over 50 runs: max = 14.8s, min = 3.8s, avg = 5.8s, dev = 2.0s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 14.4s Stats over 50 runs: max = 14.4s, min = 3.7s, avg = 5.3s, dev = 2.3s
Executed 3791 out of 3792 tests: 3790 tests pass, 1 fails to build and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Saturday 08 July 2023 22:23:19 +0100 (2:11:45.017) 3:13:14.793 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Saturday 08 July 2023 22:23:21 +0100 (0:00:01.891) 3:13:16.685 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Saturday 08 July 2023 22:23:22 +0100 (0:00:00.690) 3:13:17.375 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Saturday 08 July 2023 22:23:22 +0100 (0:00:00.694) 3:13:18.070 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Saturday 08 July 2023 22:23:23 +0100 (0:00:00.705) 3:13:18.776 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Saturday 08 July 2023 22:23:23 +0100 (0:00:00.083) 3:13:18.859 ********* ok: [localhost] => ut_tests_line: 'Executed 3791 out of 3792 tests: 3790 tests pass, 1 fails to build and 1 fails locally.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Saturday 08 July 2023 22:23:23 +0100 (0:00:00.040) 3:13:18.900 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Saturday 08 July 2023 22:23:23 +0100 (0:00:00.072) 3:13:18.972 ********* ok: [localhost] => tests_failed: - 'FAILED: //tensorflow/compiler/xla/service/gpu:fusion_merger_test (Summary)' - 'FAILED: Build did NOT complete successfully'
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Saturday 08 July 2023 22:23:23 +0100 (0:00:00.040) 3:13:19.013 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get list of wheel files] ********** Saturday 08 July 2023 22:27:56 +0100 (0:04:32.859) 3:17:51.872 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get filename of latest wheel] ***** Saturday 08 July 2023 22:27:57 +0100 (0:00:00.594) 3:17:52.466 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside] *** Saturday 08 July 2023 22:27:57 +0100 (0:00:00.060) 3:17:52.527 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Remove manylinux2014 wheel] ******* Saturday 08 July 2023 22:27:59 +0100 (0:00:02.463) 3:17:54.990 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) stop build container] ************* Saturday 08 July 2023 22:28:00 +0100 (0:00:00.377) 3:17:55.368 ********* fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container 97a0e43780e925b4df400d63ee2e60d06171a905971d34ca1adec764e2d6d223: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=600)'
PLAY RECAP ********************************************************************* localhost : ok=47 changed=32 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Saturday 08 July 2023 22:38:36 +0100 (0:10:36.625) 3:28:31.993 ********* =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 7905.02s tensorflow_in_container : (Python 3.9) build TensorFlow git ---------- 3499.56s tensorflow_in_container : (Python 3.9) stop build container ----------- 636.63s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 272.86s tensorflow_in_container : (Python 3.9) build Python package ----------- 109.87s Cleanup after previous build ------------------------------------------- 29.05s tensorflow : Fetch TensorFlow from git --------------------------------- 22.60s tensorflow_in_container : (Python 3.9) start build container ------------ 4.11s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.93s Gathering Facts --------------------------------------------------------- 2.66s tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside --- 2.46s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.99s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 1.89s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.66s Create cache dirs ------------------------------------------------------- 1.42s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.15s tensorflow : Save git commit hash to file ------------------------------- 1.13s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.88s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.85s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.84s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/850/display/redirect
Changes:
------------------------------------------ [...truncated 1.49 MB...] //tensorflow/python/saved_model:load_test_cpu PASSED in 52.7s Stats over 10 runs: max = 52.7s, min = 29.4s, avg = 35.6s, dev = 6.5s //tensorflow/compiler/tests:fft_test_cpu PASSED in 22.2s Stats over 12 runs: max = 22.2s, min = 5.2s, avg = 13.9s, dev = 5.8s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 7.7s Stats over 12 runs: max = 7.7s, min = 4.7s, avg = 6.2s, dev = 0.8s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 17.7s Stats over 12 runs: max = 17.7s, min = 5.7s, avg = 11.3s, dev = 3.5s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 36.7s Stats over 12 runs: max = 36.7s, min = 26.1s, avg = 30.9s, dev = 3.4s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 15.0s Stats over 12 runs: max = 15.0s, min = 11.4s, avg = 13.3s, dev = 1.2s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 228.4s Stats over 12 runs: max = 228.4s, min = 15.8s, avg = 52.6s, dev = 59.0s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 226.7s Stats over 12 runs: max = 226.7s, min = 15.3s, avg = 52.4s, dev = 58.4s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 23.3s Stats over 15 runs: max = 23.3s, min = 16.1s, avg = 19.7s, dev = 2.5s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 113.5s Stats over 15 runs: max = 113.5s, min = 90.3s, avg = 103.9s, dev = 4.9s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 56.5s Stats over 15 runs: max = 56.5s, min = 13.9s, avg = 19.3s, dev = 10.8s //tensorflow/compiler/tests:ftrl_test_cpu PASSED in 10.3s Stats over 16 runs: max = 10.3s, min = 4.9s, avg = 7.4s, dev = 1.8s //tensorflow/compiler/tests:ternary_ops_test_cpu PASSED in 11.1s Stats over 16 runs: max = 11.1s, min = 4.3s, avg = 7.9s, dev = 2.4s //tensorflow/compiler/tests:ternary_ops_test_cpu_mlir_bridge_test PASSED in 16.2s Stats over 16 runs: max = 16.2s, min = 9.4s, avg = 11.1s, dev = 1.7s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 17.1s Stats over 16 runs: max = 17.1s, min = 7.2s, avg = 11.2s, dev = 2.9s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 22.1s Stats over 16 runs: max = 22.1s, min = 4.3s, avg = 11.9s, dev = 5.3s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 26.7s Stats over 16 runs: max = 26.7s, min = 8.1s, avg = 18.7s, dev = 4.7s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 27.1s Stats over 16 runs: max = 27.1s, min = 7.4s, avg = 11.0s, dev = 4.6s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 12.9s Stats over 16 runs: max = 12.9s, min = 7.5s, avg = 9.2s, dev = 1.7s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 14.7s Stats over 16 runs: max = 14.7s, min = 7.6s, avg = 11.5s, dev = 2.3s //tensorflow/python/ops:image_ops_test_cpu PASSED in 20.6s Stats over 16 runs: max = 20.6s, min = 12.0s, avg = 14.4s, dev = 2.2s //tensorflow/python/data/experimental/kernel_tests/service:distributed_save_ft_test PASSED in 52.1s Stats over 17 runs: max = 52.1s, min = 6.2s, avg = 18.5s, dev = 16.7s //tensorflow/python/data/kernel_tests:map_test PASSED in 41.5s Stats over 19 runs: max = 41.5s, min = 14.8s, avg = 21.9s, dev = 5.6s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 9.8s Stats over 20 runs: max = 9.8s, min = 8.4s, avg = 9.3s, dev = 0.4s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 8.7s Stats over 20 runs: max = 8.7s, min = 3.1s, avg = 4.9s, dev = 1.9s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 13.5s Stats over 20 runs: max = 13.5s, min = 4.9s, avg = 7.8s, dev = 2.1s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 12.1s Stats over 20 runs: max = 12.1s, min = 3.7s, avg = 6.8s, dev = 2.2s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 8.7s Stats over 20 runs: max = 8.7s, min = 7.2s, avg = 7.9s, dev = 0.4s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 14.0s Stats over 20 runs: max = 14.0s, min = 10.9s, avg = 12.3s, dev = 0.7s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 12.7s Stats over 20 runs: max = 12.7s, min = 10.6s, avg = 11.8s, dev = 0.7s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 13.8s Stats over 20 runs: max = 13.8s, min = 7.5s, avg = 9.0s, dev = 1.4s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 38.3s Stats over 20 runs: max = 38.3s, min = 7.4s, avg = 16.1s, dev = 10.0s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 27.2s Stats over 20 runs: max = 27.2s, min = 20.4s, avg = 24.8s, dev = 2.0s //tensorflow/python/kernel_tests:metrics_test PASSED in 41.9s Stats over 20 runs: max = 41.9s, min = 6.3s, avg = 19.9s, dev = 9.8s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 55.9s Stats over 20 runs: max = 55.9s, min = 47.3s, avg = 51.7s, dev = 2.6s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 11.1s Stats over 20 runs: max = 11.1s, min = 3.8s, avg = 6.6s, dev = 2.4s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 37.9s Stats over 20 runs: max = 37.9s, min = 4.2s, avg = 14.7s, dev = 11.2s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 109.5s Stats over 20 runs: max = 109.5s, min = 38.1s, avg = 61.8s, dev = 19.4s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 9.7s Stats over 20 runs: max = 9.7s, min = 4.3s, avg = 6.1s, dev = 1.9s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 17.7s Stats over 20 runs: max = 17.7s, min = 8.0s, avg = 11.1s, dev = 2.2s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 191.2s Stats over 20 runs: max = 191.2s, min = 34.8s, avg = 96.8s, dev = 50.6s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 25.4s Stats over 20 runs: max = 25.4s, min = 7.1s, avg = 13.4s, dev = 5.5s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 28.4s Stats over 20 runs: max = 28.4s, min = 7.8s, avg = 16.5s, dev = 7.0s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 22.0s Stats over 20 runs: max = 22.0s, min = 14.9s, avg = 19.1s, dev = 2.0s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 74.5s Stats over 20 runs: max = 74.5s, min = 5.3s, avg = 29.9s, dev = 22.7s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 20.9s Stats over 20 runs: max = 20.9s, min = 10.7s, avg = 13.9s, dev = 2.2s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 23.3s Stats over 24 runs: max = 23.3s, min = 9.6s, avg = 16.4s, dev = 3.4s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 24.4s Stats over 24 runs: max = 24.4s, min = 6.7s, avg = 15.3s, dev = 4.6s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 22.2s Stats over 24 runs: max = 22.2s, min = 4.3s, avg = 9.0s, dev = 4.2s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 8.2s Stats over 25 runs: max = 8.2s, min = 7.3s, avg = 7.7s, dev = 0.2s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 34.5s Stats over 25 runs: max = 34.5s, min = 7.9s, avg = 12.0s, dev = 6.9s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 7.8s Stats over 30 runs: max = 7.8s, min = 7.1s, avg = 7.4s, dev = 0.2s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 16.2s Stats over 30 runs: max = 16.2s, min = 12.9s, avg = 14.0s, dev = 0.9s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 8.3s Stats over 30 runs: max = 8.3s, min = 7.0s, avg = 7.4s, dev = 0.4s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 20.6s Stats over 30 runs: max = 20.6s, min = 8.0s, avg = 10.8s, dev = 3.0s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 19.0s Stats over 30 runs: max = 19.0s, min = 3.9s, avg = 8.6s, dev = 3.6s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 9.7s Stats over 31 runs: max = 9.7s, min = 7.8s, avg = 8.7s, dev = 0.5s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 9.8s Stats over 32 runs: max = 9.8s, min = 7.4s, avg = 8.1s, dev = 0.5s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 19.8s Stats over 32 runs: max = 19.8s, min = 4.1s, avg = 8.9s, dev = 4.0s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 10.4s Stats over 40 runs: max = 10.4s, min = 7.9s, avg = 9.0s, dev = 0.9s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 10.6s Stats over 40 runs: max = 10.6s, min = 7.7s, avg = 9.1s, dev = 1.0s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 17.3s Stats over 40 runs: max = 17.3s, min = 8.8s, avg = 11.8s, dev = 1.8s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 11.3s Stats over 40 runs: max = 11.3s, min = 7.4s, avg = 8.7s, dev = 0.7s //tensorflow/core/kernels:stochastic_cast_op_test PASSED in 1.6s Stats over 48 runs: max = 1.6s, min = 0.4s, avg = 0.7s, dev = 0.3s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 52.2s Stats over 50 runs: max = 52.2s, min = 19.0s, avg = 35.0s, dev = 8.7s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 38.0s Stats over 50 runs: max = 38.0s, min = 3.5s, avg = 10.9s, dev = 7.5s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 36.9s Stats over 50 runs: max = 36.9s, min = 3.3s, avg = 11.1s, dev = 7.7s //tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 23.0s Stats over 50 runs: max = 23.0s, min = 3.7s, avg = 7.4s, dev = 3.7s //tensorflow/compiler/tests:unary_ops_test_cpu_mlir_bridge_test PASSED in 26.9s Stats over 50 runs: max = 26.9s, min = 3.6s, avg = 7.5s, dev = 5.3s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 11.5s Stats over 50 runs: max = 11.5s, min = 9.0s, avg = 10.0s, dev = 0.7s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 14.4s Stats over 50 runs: max = 14.4s, min = 10.0s, avg = 12.7s, dev = 1.2s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 13.2s Stats over 50 runs: max = 13.2s, min = 9.2s, avg = 11.1s, dev = 0.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 21.7s Stats over 50 runs: max = 21.7s, min = 6.1s, avg = 12.6s, dev = 4.5s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 10.0s Stats over 50 runs: max = 10.0s, min = 3.9s, avg = 5.4s, dev = 1.6s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 10.9s Stats over 50 runs: max = 10.9s, min = 3.4s, avg = 5.5s, dev = 2.1s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 26.8s Stats over 50 runs: max = 26.8s, min = 7.7s, avg = 14.0s, dev = 5.0s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 15.9s Stats over 50 runs: max = 15.9s, min = 3.9s, avg = 6.6s, dev = 2.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 14.4s Stats over 50 runs: max = 14.4s, min = 3.9s, avg = 6.2s, dev = 2.5s
Executed 3791 out of 3792 tests: 3790 tests pass, 1 fails to build and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Sunday 09 July 2023 22:24:44 +0100 (2:13:56.009) 3:14:39.796 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Sunday 09 July 2023 22:24:46 +0100 (0:00:01.897) 3:14:41.694 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Sunday 09 July 2023 22:24:47 +0100 (0:00:00.690) 3:14:42.384 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Sunday 09 July 2023 22:24:47 +0100 (0:00:00.699) 3:14:43.084 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Sunday 09 July 2023 22:24:48 +0100 (0:00:00.706) 3:14:43.791 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Sunday 09 July 2023 22:24:48 +0100 (0:00:00.078) 3:14:43.869 *********** ok: [localhost] => ut_tests_line: 'Executed 3791 out of 3792 tests: 3790 tests pass, 1 fails to build and 1 fails locally.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Sunday 09 July 2023 22:24:48 +0100 (0:00:00.040) 3:14:43.910 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Sunday 09 July 2023 22:24:48 +0100 (0:00:00.071) 3:14:43.982 *********** ok: [localhost] => tests_failed: - 'FAILED: //tensorflow/compiler/xla/service/gpu:fusion_merger_test (Summary)' - 'FAILED: Build did NOT complete successfully'
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Sunday 09 July 2023 22:24:48 +0100 (0:00:00.065) 3:14:44.047 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get list of wheel files] ********** Sunday 09 July 2023 22:29:21 +0100 (0:04:32.461) 3:19:16.509 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get filename of latest wheel] ***** Sunday 09 July 2023 22:29:21 +0100 (0:00:00.593) 3:19:17.102 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside] *** Sunday 09 July 2023 22:29:21 +0100 (0:00:00.059) 3:19:17.162 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Remove manylinux2014 wheel] ******* Sunday 09 July 2023 22:29:24 +0100 (0:00:02.480) 3:19:19.643 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) stop build container] ************* Sunday 09 July 2023 22:29:24 +0100 (0:00:00.376) 3:19:20.019 *********** fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container 492a976c30540cea70e67f5a3ce8cc1ff05e3412f93357aa024a32f4ee46a2f6: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=600)'
PLAY RECAP ********************************************************************* localhost : ok=47 changed=32 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Sunday 09 July 2023 22:39:58 +0100 (0:10:33.527) 3:29:53.546 *********** =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow git tests ------ 8036.01s tensorflow_in_container : (Python 3.9) build TensorFlow git ---------- 3453.61s tensorflow_in_container : (Python 3.9) stop build container ----------- 633.53s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 272.46s tensorflow_in_container : (Python 3.9) build Python package ----------- 109.61s Cleanup after previous build ------------------------------------------- 29.48s tensorflow : Fetch TensorFlow from git --------------------------------- 22.95s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.96s tensorflow_in_container : (Python 3.9) start build container ------------ 3.63s Gathering Facts --------------------------------------------------------- 2.65s tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside --- 2.48s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.94s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 1.90s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.61s Create cache dirs ------------------------------------------------------- 1.42s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.20s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.85s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.85s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.81s Build step 'Execute shell' marked build as failure
ldcg-ai-ml@op-lists.linaro.org
-
ci_notify＠linaro.org