2022-07-04 12:54:32.257000: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  SSE4.2 AVX AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
Metal device set to: AMD Radeon PRO W6800

systemMemory: 64.00 GB
maxCacheSize: 14.99 GB

2022-07-04 12:54:32.257532: I tensorflow/core/common_runtime/pluggable_device/pluggable_device_factory.cc:305] Could not identify NUMA node of platform GPU ID 0, defaulting to 0. Your kernel may not have been built with NUMA support.
2022-07-04 12:54:32.257826: I tensorflow/core/common_runtime/pluggable_device/pluggable_device_factory.cc:271] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 0 MB memory) -> physical PluggableDevice (device: 0, name: METAL, pci bus id: <undefined>)
2022-07-04 12:54:32.418185: W tensorflow/core/platform/cloud/google_auth_provider.cc:184] All attempts to get a Google authentication bearer token failed, returning an empty token. Retrieving token from files failed with "Not found: Could not locate the credentials file.". Retrieving token from GCE failed with "Failed precondition: Error executing an HTTP request: libcurl code 6 meaning 'Couldn't resolve host name', error details: Could not resolve host: metadata".
INFO:absl:Load pre-computed DatasetInfo (eg: splits, num examples,...) from GCS: glue/mrpc/2.0.0
INFO:absl:Load dataset info from /var/folders/sc/6cxc1l157xvb_54rgcrpk43r0000gn/T/tmpzvc3uw5ttfds
INFO:absl:Field info.release_notes from disk and from code do not match. Keeping the one from code.
INFO:absl:Field info.splits from disk and from code do not match. Keeping the one from code.
INFO:absl:Generating dataset glue (~/tensorflow_datasets/glue/mrpc/2.0.0)
Downloading and preparing dataset 1.43 MiB (download: 1.43 MiB, generated: 1.74 MiB, total: 3.17 MiB) to ~/tensorflow_datasets/glue/mrpc/2.0.0...
Dl Completed...: 0 url [00:00, ? uINFO:absl:Downloading https://firebasestorage.googleapis.com/v0/b/mtl-sentence-representations.appspot.com/o/data%2Fmrpc_dev_ids.tsv?alt=media&token=ec5c0836-31d5-48f4-b431-7480817f1adc into /Users/ashvid/tensorflow_datasets/downloads/fire.goog.com_v0_b_mtl-sent-repr.apps.com_o_2FjSIMlCiqs1QSmIykr4IRPnEHjPuGwAz5i40v8K9U0Z8.tsvalt=media&token=ec5c0836-31d5-48f4-b431-7480817f1adc.tmp.0c6b03e518f444e7b3467170caa3704a...
Dl Completed...:   0%|            INFO:absl:Downloading https://dl.fbaipublicfiles.com/senteval/senteval_data/msr_paraphrase_test.txt into /Users/ashvid/tensorflow_datasets/downloads/dl.fbaip.com_sente_sente_msr_parap_test0PdekMcyqYR-w4Rx_d7OTryq0J3RlYRn4rAMajy9Mak.txt.tmp.05aee794453d4a0aace91f5dd58f6cb7...
Dl Completed...:   0%|            INFO:absl:Downloading https://dl.fbaipublicfiles.com/senteval/senteval_data/msr_paraphrase_train.txt into /Users/ashvid/tensorflow_datasets/downloads/dl.fbaip.com_sente_sente_msr_parap_trainfGxPZuQWGBti4Tbd1YNOwQr-OqxPejJ7gcp0Al6mlSk.txt.tmp.07870e451a5a4814a691b8d0a4840537...
Dl Size...: 0 MiB [00:00, ? MiB/s]██████████████| 3/3 [00:00<00:00,  1.16 url/s]
Dl Completed...: 100%|██████████████████████████| 3/3 [00:00<00:00,  3.30 url/s]
Generating splits...:   0%|                          | 0/3 [00:00<?, ? splits/sINFO:absl:Done writing ~/tensorflow_datasets/glue/mrpc/2.0.0.incompleteTZ8OS0/glue-train.tfrecord*. Number of examples: 3668 (shards: [3668])
Generating splits...:  33%|██████            | 1/3 [00:00<00:00,  2.01 splits/sINFO:absl:Done writing ~/tensorflow_datasets/glue/mrpc/2.0.0.incompleteTZ8OS0/glue-validation.tfrecord*. Number of examples: 408 (shards: [408])
Generating splits...:  67%|████████████      | 2/3 [00:00<00:00,  3.64 splits/sINFO:absl:Done writing ~/tensorflow_datasets/glue/mrpc/2.0.0.incompleteTZ8OS0/glue-test.tfrecord*. Number of examples: 1725 (shards: [1725])
Dataset glue downloaded and prepared to ~/tensorflow_datasets/glue/mrpc/2.0.0. Subsequent calls will reuse this data.
INFO:absl:Constructing tf.data.Dataset glue for split None, from ~/tensorflow_datasets/glue/mrpc/2.0.0
/Users/ashvid/Library/Python/3.8/lib/python/site-packages/transformers/data/processors/glue.py:67: FutureWarning: This function will be removed from the library soon, preprocessing should be handled with the 🤗 Datasets library. You can have a look at this example script for pointers: https://github.com/huggingface/transformers/blob/master/examples/pytorch/text-classification/run_glue.py
  warnings.warn(DEPRECATION_WARNING.format("function"), FutureWarning)
/Users/ashvid/Library/Python/3.8/lib/python/site-packages/transformers/data/processors/glue.py:175: FutureWarning: This processor will be removed from the library soon, preprocessing should be handled with the 🤗 Datasets library. You can have a look at this example script for pointers: https://github.com/huggingface/transformers/blob/master/examples/pytorch/text-classification/run_glue.py
  warnings.warn(DEPRECATION_WARNING.format("processor"), FutureWarning)
2022-07-04 12:54:35.611684: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)
Epoch 1/5
2022-07-04 12:54:48.535282: I tensorflow/core/grappler/optimizers/custom_graph_optimizer_registry.cc:112] Plugin optimizer for device_type GPU is enabled.
115/115 [==============================] - ETA: 0s - loss: 0.65152022-07-04 12:56:08.822813: I tensorflow/core/grappler/optimizers/custom_graph_optimizer_registry.cc:112] Plugin optimizer for device_type GPU is enabled.
115/115 [==============================] - 106s 808ms/step - loss: 0.6515 - val_loss: 0.6475
Epoch 2/5
115/115 [==============================] - 90s 780ms/step - loss: 0.6400 - val_loss: 0.6242
Epoch 3/5
115/115 [==============================] - 90s 783ms/step - loss: 0.6112 - val_loss: 0.6083
Epoch 4/5
115/115 [==============================] - 107s 933ms/step - loss: 0.5180 - val_loss: 0.6405
Epoch 5/5
115/115 [==============================] - 117s 1s/step - loss: 0.3811 - val_loss: 0.8689