See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/341/display/redirect
Changes:
------------------------------------------ [...truncated 32.00 MB...] //tensorflow/python:nn_fused_batchnorm_d9m_test_cpu PASSED in 13.1s Stats over 4 runs: max = 13.1s, min = 12.7s, avg = 13.0s, dev = 0.2s //tensorflow/python/data/experimental/kernel_tests:parse_example_dataset_test PASSED in 23.0s Stats over 4 runs: max = 23.0s, min = 10.9s, avg = 17.1s, dev = 5.8s //tensorflow/python/data/experimental/kernel_tests:sql_dataset_test PASSED in 24.2s Stats over 4 runs: max = 24.2s, min = 19.5s, avg = 22.0s, dev = 1.8s //tensorflow/python/data/experimental/kernel_tests/service:cross_trainer_cache_ft_test PASSED in 6.9s Stats over 4 runs: max = 6.9s, min = 5.8s, avg = 6.4s, dev = 0.5s //tensorflow/python/data/kernel_tests:batch_test PASSED in 30.8s Stats over 4 runs: max = 30.8s, min = 21.4s, avg = 25.1s, dev = 3.5s //tensorflow/python/data/kernel_tests:fixed_length_record_dataset_test PASSED in 16.6s Stats over 4 runs: max = 16.6s, min = 7.6s, avg = 12.2s, dev = 4.1s //tensorflow/python/data/kernel_tests:ragged_batch_test PASSED in 17.0s Stats over 4 runs: max = 17.0s, min = 14.5s, avg = 16.1s, dev = 1.0s //tensorflow/python/data/kernel_tests:shuffle_test PASSED in 31.1s Stats over 4 runs: max = 31.1s, min = 22.4s, avg = 26.5s, dev = 3.3s //tensorflow/python/debug/lib:dumping_callback_test_cpu PASSED in 15.2s Stats over 4 runs: max = 15.2s, min = 14.1s, avg = 14.7s, dev = 0.5s //tensorflow/python/distribute:cross_device_ops_test_cpu PASSED in 27.6s Stats over 4 runs: max = 27.6s, min = 19.1s, avg = 23.5s, dev = 3.4s //tensorflow/python/distribute:strategy_gather_test_2gpu PASSED in 22.1s Stats over 4 runs: max = 22.1s, min = 12.2s, avg = 17.3s, dev = 4.7s //tensorflow/python/distribute:strategy_gather_test_cpu PASSED in 24.4s Stats over 4 runs: max = 24.4s, min = 13.3s, avg = 18.7s, dev = 5.4s //tensorflow/python/kernel_tests:collective_ops_test_2gpu PASSED in 32.7s Stats over 4 runs: max = 32.7s, min = 29.9s, avg = 31.2s, dev = 1.1s //tensorflow/python/kernel_tests:collective_ops_test_cpu PASSED in 31.1s Stats over 4 runs: max = 31.1s, min = 30.0s, avg = 30.5s, dev = 0.5s //tensorflow/python/kernel_tests/array_ops:concat_op_test_cpu PASSED in 12.9s Stats over 4 runs: max = 12.9s, min = 10.9s, avg = 11.8s, dev = 0.8s //tensorflow/python/kernel_tests/random:random_gamma_test_cpu PASSED in 71.7s Stats over 4 runs: max = 71.7s, min = 6.3s, avg = 34.1s, dev = 28.5s //tensorflow/python/kernel_tests/signal:window_ops_test_cpu PASSED in 14.6s Stats over 4 runs: max = 14.6s, min = 14.2s, avg = 14.3s, dev = 0.1s //tensorflow/python/ops/ragged:ragged_getitem_test PASSED in 43.4s Stats over 4 runs: max = 43.4s, min = 40.1s, avg = 41.9s, dev = 1.2s //tensorflow/compiler/tests:conv3d_test_cpu PASSED in 13.2s Stats over 5 runs: max = 13.2s, min = 2.8s, avg = 7.5s, dev = 3.9s //tensorflow/compiler/tests:depthwise_conv_op_test_cpu PASSED in 13.9s Stats over 5 runs: max = 13.9s, min = 6.4s, avg = 9.8s, dev = 2.9s //tensorflow/compiler/tests:repeat_op_test_cpu PASSED in 6.4s Stats over 5 runs: max = 6.4s, min = 4.7s, avg = 5.3s, dev = 0.6s //tensorflow/compiler/tests:repeat_op_test_cpu_mlir_bridge_test PASSED in 6.3s Stats over 5 runs: max = 6.3s, min = 3.8s, avg = 4.8s, dev = 0.9s //tensorflow/python/distribute:mirrored_strategy_test_2gpu PASSED in 10.2s Stats over 5 runs: max = 10.2s, min = 8.3s, avg = 9.0s, dev = 0.7s //tensorflow/python/distribute:mirrored_strategy_test_cpu PASSED in 9.3s Stats over 5 runs: max = 9.3s, min = 7.7s, avg = 8.4s, dev = 0.6s //tensorflow/python/eager:forwardprop_test_cpu PASSED in 94.7s Stats over 5 runs: max = 94.7s, min = 13.6s, avg = 41.5s, dev = 27.9s //tensorflow/python/eager/polymorphic_function:gradients_test_cpu PASSED in 12.7s Stats over 5 runs: max = 12.7s, min = 8.1s, avg = 10.1s, dev = 1.8s //tensorflow/python/kernel_tests/linalg:cholesky_op_test_cpu PASSED in 67.7s Stats over 5 runs: max = 67.7s, min = 32.9s, avg = 43.4s, dev = 12.8s //tensorflow/python/kernel_tests/linalg:linear_operator_composition_test_cpu PASSED in 39.8s Stats over 5 runs: max = 39.8s, min = 37.4s, avg = 38.9s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:linear_operator_diag_test_cpu PASSED in 22.8s Stats over 5 runs: max = 22.8s, min = 21.8s, avg = 22.4s, dev = 0.3s //tensorflow/python/kernel_tests/linalg:linear_operator_householder_test_cpu PASSED in 21.1s Stats over 5 runs: max = 21.1s, min = 18.2s, avg = 19.5s, dev = 1.1s //tensorflow/python/kernel_tests/linalg:linear_operator_permutation_test_cpu PASSED in 29.3s Stats over 5 runs: max = 29.3s, min = 27.9s, avg = 28.8s, dev = 0.5s //tensorflow/python/kernel_tests/linalg:linear_operator_toeplitz_test_cpu PASSED in 13.7s Stats over 5 runs: max = 13.7s, min = 11.0s, avg = 11.9s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:linear_operator_tridiag_test_cpu PASSED in 81.2s Stats over 5 runs: max = 81.2s, min = 77.1s, avg = 78.4s, dev = 1.5s //tensorflow/python/kernel_tests/nn_ops:fractional_max_pool_op_test PASSED in 11.8s Stats over 5 runs: max = 11.8s, min = 2.7s, avg = 5.6s, dev = 3.3s //tensorflow/python/ops/parallel_for:math_test_cpu PASSED in 71.0s Stats over 5 runs: max = 71.0s, min = 23.9s, avg = 42.9s, dev = 16.9s //tensorflow/compiler/tests:scan_ops_test_cpu_mlir_bridge_test PASSED in 19.9s Stats over 6 runs: max = 19.9s, min = 13.9s, avg = 17.2s, dev = 1.8s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 7.4s Stats over 6 runs: max = 7.4s, min = 6.3s, avg = 6.6s, dev = 0.4s //tensorflow/python/kernel_tests/math_ops:reduction_ops_test_cpu PASSED in 32.0s Stats over 6 runs: max = 32.0s, min = 16.6s, avg = 25.0s, dev = 4.6s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu_mlir_bridge_test PASSED in 67.4s Stats over 8 runs: max = 67.4s, min = 3.5s, avg = 25.6s, dev = 22.1s //tensorflow/python/data/experimental/kernel_tests:parallel_interleave_test PASSED in 26.4s Stats over 8 runs: max = 26.4s, min = 9.1s, avg = 17.5s, dev = 5.9s //tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test PASSED in 18.8s Stats over 8 runs: max = 18.8s, min = 11.4s, avg = 14.5s, dev = 2.6s //tensorflow/python/data/kernel_tests:filter_test PASSED in 15.1s Stats over 8 runs: max = 15.1s, min = 11.7s, avg = 13.1s, dev = 1.2s //tensorflow/python/data/kernel_tests:flat_map_test PASSED in 19.5s Stats over 8 runs: max = 19.5s, min = 11.2s, avg = 15.3s, dev = 3.1s //tensorflow/python/distribute/failure_handling:failure_handler_test PASSED in 44.7s Stats over 8 runs: max = 44.7s, min = 12.1s, avg = 32.5s, dev = 10.6s //tensorflow/python/ops/ragged:dynamic_ragged_shape_test PASSED in 42.8s Stats over 8 runs: max = 42.8s, min = 26.7s, avg = 33.2s, dev = 5.3s //tensorflow/compiler/tests:bincount_op_test_cpu PASSED in 5.9s Stats over 10 runs: max = 5.9s, min = 5.3s, avg = 5.4s, dev = 0.2s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 5.9s Stats over 10 runs: max = 5.9s, min = 4.5s, avg = 5.5s, dev = 0.4s //tensorflow/compiler/tests:image_ops_test_cpu PASSED in 13.9s Stats over 10 runs: max = 13.9s, min = 8.3s, avg = 11.2s, dev = 2.1s //tensorflow/compiler/tests:random_ops_test_cpu PASSED in 17.7s Stats over 10 runs: max = 17.7s, min = 10.2s, avg = 14.1s, dev = 2.3s //tensorflow/compiler/xla/client/lib:svd_test_cpu PASSED in 64.6s Stats over 10 runs: max = 64.6s, min = 6.6s, avg = 23.0s, dev = 21.7s //tensorflow/compiler/xla/client/lib:tridiagonal_test_cpu PASSED in 6.9s Stats over 10 runs: max = 6.9s, min = 6.1s, avg = 6.6s, dev = 0.2s //tensorflow/python:special_math_ops_test_cpu PASSED in 42.2s Stats over 10 runs: max = 42.2s, min = 5.2s, avg = 11.6s, dev = 10.4s //tensorflow/python/distribute:input_lib_type_spec_test_2gpu PASSED in 15.5s Stats over 10 runs: max = 15.5s, min = 4.1s, avg = 10.0s, dev = 3.8s //tensorflow/python/distribute:input_lib_type_spec_test_cpu PASSED in 15.6s Stats over 10 runs: max = 15.6s, min = 6.2s, avg = 10.8s, dev = 3.3s //tensorflow/python/kernel_tests/array_ops:array_ops_test_cpu PASSED in 11.3s Stats over 10 runs: max = 11.3s, min = 6.5s, avg = 8.6s, dev = 1.4s //tensorflow/python/kernel_tests/linalg:linear_operator_low_rank_update_test_cpu PASSED in 67.5s Stats over 10 runs: max = 67.5s, min = 62.6s, avg = 64.6s, dev = 1.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_ops_test_cpu PASSED in 24.5s Stats over 10 runs: max = 24.5s, min = 6.6s, avg = 15.3s, dev = 5.8s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test_cpu PASSED in 22.9s Stats over 10 runs: max = 22.9s, min = 3.7s, avg = 9.0s, dev = 6.2s //tensorflow/python/kernel_tests/nn_ops:rnn_test_cpu PASSED in 8.7s Stats over 10 runs: max = 8.7s, min = 4.6s, avg = 6.9s, dev = 1.5s //tensorflow/python/kernel_tests/random:random_index_shuffle_test PASSED in 6.6s Stats over 10 runs: max = 6.6s, min = 5.8s, avg = 6.2s, dev = 0.3s //tensorflow/python/ops/ragged:ragged_tensor_supported_values_test PASSED in 16.1s Stats over 10 runs: max = 16.1s, min = 13.1s, avg = 14.2s, dev = 0.9s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 12.8s Stats over 12 runs: max = 12.8s, min = 5.1s, avg = 8.8s, dev = 1.8s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 221.4s Stats over 12 runs: max = 221.4s, min = 12.2s, avg = 48.8s, dev = 58.0s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 14.1s Stats over 15 runs: max = 14.1s, min = 10.2s, avg = 11.5s, dev = 1.4s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 45.1s Stats over 15 runs: max = 45.1s, min = 4.6s, avg = 11.2s, dev = 9.7s //tensorflow/python:image_ops_test_cpu PASSED in 12.5s Stats over 16 runs: max = 12.5s, min = 5.7s, avg = 9.3s, dev = 2.0s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 19.0s Stats over 16 runs: max = 19.0s, min = 7.8s, avg = 13.1s, dev = 3.2s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 18.7s Stats over 16 runs: max = 18.7s, min = 2.9s, avg = 9.8s, dev = 4.5s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 22.1s Stats over 16 runs: max = 22.1s, min = 9.1s, avg = 14.1s, dev = 3.8s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 9.2s Stats over 16 runs: max = 9.2s, min = 6.2s, avg = 7.5s, dev = 1.0s //tensorflow/python/ops/parallel_for:control_flow_ops_test_cpu PASSED in 55.5s Stats over 16 runs: max = 55.5s, min = 9.5s, avg = 17.1s, dev = 10.6s //tensorflow/python/data/kernel_tests:map_test PASSED in 33.2s Stats over 19 runs: max = 33.2s, min = 9.9s, avg = 16.1s, dev = 5.4s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 9.1s Stats over 20 runs: max = 9.1s, min = 2.6s, avg = 4.4s, dev = 2.0s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 10.7s Stats over 20 runs: max = 10.7s, min = 2.7s, avg = 4.9s, dev = 1.8s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 10.0s Stats over 20 runs: max = 10.0s, min = 2.8s, avg = 4.5s, dev = 1.9s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 6.8s Stats over 20 runs: max = 6.8s, min = 6.0s, avg = 6.3s, dev = 0.2s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.2s Stats over 20 runs: max = 13.2s, min = 9.0s, avg = 11.3s, dev = 1.2s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 11.3s Stats over 20 runs: max = 11.3s, min = 9.5s, avg = 10.2s, dev = 0.5s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 41.4s Stats over 20 runs: max = 41.4s, min = 6.4s, avg = 14.1s, dev = 10.2s //tensorflow/python/kernel_tests:metrics_test PASSED in 37.8s Stats over 20 runs: max = 37.8s, min = 6.3s, avg = 17.4s, dev = 8.8s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 5.2s Stats over 20 runs: max = 5.2s, min = 2.5s, avg = 2.9s, dev = 0.7s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 12.3s Stats over 20 runs: max = 12.3s, min = 2.7s, avg = 5.1s, dev = 2.5s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 38.8s Stats over 20 runs: max = 38.8s, min = 4.0s, avg = 12.8s, dev = 11.2s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 95.0s Stats over 20 runs: max = 95.0s, min = 25.9s, avg = 52.5s, dev = 19.9s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 10.9s Stats over 20 runs: max = 10.9s, min = 4.4s, avg = 7.7s, dev = 2.0s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 16.5s Stats over 20 runs: max = 16.5s, min = 14.6s, avg = 15.3s, dev = 0.6s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 20.2s Stats over 20 runs: max = 20.2s, min = 2.6s, avg = 6.3s, dev = 4.3s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 19.5s Stats over 24 runs: max = 19.5s, min = 3.5s, avg = 9.1s, dev = 4.6s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 7.0s Stats over 25 runs: max = 7.0s, min = 6.1s, avg = 6.3s, dev = 0.2s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 7.7s Stats over 30 runs: max = 7.7s, min = 6.2s, avg = 6.7s, dev = 0.3s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 6.7s Stats over 30 runs: max = 6.7s, min = 5.9s, avg = 6.3s, dev = 0.2s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 29.4s Stats over 30 runs: max = 29.4s, min = 2.7s, avg = 9.8s, dev = 6.4s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 21.3s Stats over 32 runs: max = 21.3s, min = 6.7s, avg = 13.0s, dev = 3.9s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 8.8s Stats over 40 runs: max = 8.8s, min = 7.1s, avg = 8.0s, dev = 0.4s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 11.0s Stats over 40 runs: max = 11.0s, min = 6.7s, avg = 8.3s, dev = 1.1s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 86.7s Stats over 50 runs: max = 86.7s, min = 16.8s, avg = 38.4s, dev = 25.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 12.5s Stats over 50 runs: max = 12.5s, min = 3.8s, avg = 7.2s, dev = 2.3s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 5.6s Stats over 50 runs: max = 5.6s, min = 2.5s, avg = 3.7s, dev = 1.0s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 9.8s Stats over 50 runs: max = 9.8s, min = 2.5s, avg = 3.6s, dev = 1.7s
Executed 1625 out of 3594 tests: 1624 tests pass, 1170 fail to build, 1 fails locally and 799 were skipped. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Thursday 16 February 2023 03:41:45 +0000 (0:54:53.207) 1:45:41.251 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] *** Thursday 16 February 2023 03:41:47 +0000 (0:00:01.848) 1:45:43.099 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ******** Thursday 16 February 2023 03:41:48 +0000 (0:00:00.694) 1:45:43.793 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] *** Thursday 16 February 2023 03:41:48 +0000 (0:00:00.754) 1:45:44.547 ***** An exception occurred during task execution. To see the full traceback, use -vvv. The error was: OSError: [Errno 28] No space left on device fatal: [localhost]: FAILED! => msg: Unexpected failure during module execution. stdout: ''
PLAY RECAP ********************************************************************* localhost : ok=35 changed=28 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Thursday 16 February 2023 03:41:49 +0000 (0:00:00.174) 1:45:44.722 ***** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 3293.21s tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2857.22s tensorflow_in_container : (Python 3.8) build Python package ----------- 116.62s tensorflow_in_container : (Python 3.8) install Python packages --------- 28.44s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 20.24s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.82s tensorflow_in_container : (Python 3.8) start build container ------------ 3.82s tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 1.85s Gathering Facts --------------------------------------------------------- 1.63s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.23s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 0.94s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.85s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.84s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.80s tensorflow_in_container : (Python 3.8) save tests output to file -------- 0.75s tensorflow : Create readme file about unit tests ------------------------ 0.73s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s Build step 'Execute shell' marked build as failure
ldcg-ai-ml@op-lists.linaro.org