nipunsadvilkar commited on
Commit
749dddc
·
1 Parent(s): c15231b

Saving weights and logs of step 1000

Browse files
events.out.tfevents.1625837383.t1v-n-112df4a9-w-0.40707.3.v2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4ec736bc8abd916bc25abb12f5b5d593cf4ee79dccebf89ba42f23e36a668e1e
3
- size 11274
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d576eeb6e9baef5368f0159c5dfb1991bd8e842e82fbdb6a3608b84b78cbfd87
3
+ size 12512
flax_model.msgpack CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1f30bd95331d281308f6cb94e74bec0d82ebc06684501d536c8d38952e09abb
3
  size 498796983
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76d55c57630984430801c3b6d5cc75703bd2a61ef6bb8f9d20f7c6150f2dfbd3
3
  size 498796983
run.log CHANGED
@@ -266,3 +266,147 @@ Step... (500 | Loss: 8.018753051757812, Learning Rate: 0.0001500000071246177)
266
  [13:31:24] - INFO - huggingface_hub.repository - git version 2.25.1
267
  git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)
268
  [13:31:24] - DEBUG - huggingface_hub.repository - [Repository] is a valid git repo
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
269
 
 
270
 
 
 
 
 
 
 
 
 
 
 
266
  [13:31:24] - INFO - huggingface_hub.repository - git version 2.25.1
267
  git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)
268
  [13:31:24] - DEBUG - huggingface_hub.repository - [Repository] is a valid git repo
269
+ [13:31:35] - INFO - huggingface_hub.repository - Uploading LFS objects: 100% (2/2), 499 MB | 0 B/s, done.
270
+
271
+
272
+
273
+
274
+
275
+
276
+
277
+
278
+
279
+
280
+
281
+
282
+
283
+
284
+
285
+
286
+
287
+
288
+
289
+
290
+
291
+
292
+
293
+
294
+
295
+
296
+
297
+
298
+
299
+
300
+
301
+
302
+
303
+
304
+
305
+
306
+
307
+
308
+
309
+
310
+
311
+
312
+
313
+
314
+
315
+
316
+
317
+
318
+
319
+
320
+
321
+
322
+
323
+
324
+
325
+
326
+
327
+
328
+
329
+
330
+
331
+
332
+
333
+
334
+
335
+
336
+
337
+
338
+
339
+
340
+
341
+
342
+
343
+
344
+
345
+
346
+
347
+
348
+
349
+
350
+
351
+
352
+
353
+
354
+
355
+
356
+
357
+
358
+
359
+
360
+
361
+
362
+
363
+
364
+
365
+
366
+
367
+
368
+
369
+
370
+
371
+
372
+
373
+
374
+
375
+
376
+
377
+
378
+
379
+
380
+
381
+
382
+
383
+
384
+
385
+
386
+
387
+
388
+
389
+
390
+
391
+
392
+
393
+
394
+
395
+
396
+
397
+
398
+
399
+
400
+
401
+
402
+
403
 
404
+
405
 
406
+
407
+
408
+
409
+
410
+
411
+
412
+ [13:31:54] - INFO - huggingface_hub.repository - git version 2.25.1
413
+ git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)
414
+ [13:31:54] - DEBUG - huggingface_hub.repository - [Repository] is a valid git repo
wandb/run-20210709_132941-xrzp5klf/files/output.log CHANGED
@@ -18,3 +18,17 @@ Training...: 51%|████████████████████
18
  Step... (500 | Loss: 8.018753051757812, Learning Rate: 0.0001500000071246177)
19
 
20
  git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)████████████████████████████████████████████████████████████████████████████████████▊ | 9/10 [00:04<00:00, 2.78it/s]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  Step... (500 | Loss: 8.018753051757812, Learning Rate: 0.0001500000071246177)
19
 
20
  git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)████████████████████████████████████████████████████████████████████████████████████▊ | 9/10 [00:04<00:00, 2.78it/s]
21
+ [13:31:24] - DEBUG - huggingface_hub.repository - [Repository] is a valid git repo
22
+ [13:31:35] - INFO - huggingface_hub.repository - Uploading LFS objects: 100% (2/2), 499 MB | 0 B/s, done.
23
+
24
+ Step... (500 | Loss: 8.205772399902344, Acc: 0.0773010179400444): 50%|████████████████████████████████████▌ | 4/8 [01:49<01:26, 21.60s/it]
25
+
26
+ Step... (500 | Loss: 8.205772399902344, Acc: 0.0773010179400444): 62%|█████████████████████████████████████████████▋ | 5/8 [01:54<00:46, 15.52s/it]
27
+
28
+
29
+ Step... (500 | Loss: 8.205772399902344, Acc: 0.0773010179400444): 75%|██████████████████████████████████████████████████████▊ | 6/8 [01:59<00:23, 11.93s/it]
30
+
31
+ Step... (500 | Loss: 8.205772399902344, Acc: 0.0773010179400444): 88%|███████████████████████████████████████████████████████████████▉ | 7/8 [02:05<00:09, 9.68s/it]
32
+ Training...: 3%|███▍ | 4/142 [00:00<00:03, 35.60it/s]
33
+ Evaluating ...: 0%| | 0/10 [00:00<?, ?it/s]
34
+ git-lfs/2.9.2 (GitHub; linux amd64; go 1.13.5)████████████████████████████████████████████████████████████████████████▌ | 8/10 [00:00<00:00, 76.30it/s]
wandb/run-20210709_132941-xrzp5klf/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"global_step": 500, "_timestamp": 1625837479.093119, "train_time": 3.031515121459961, "train_learning_rate": 0.0001500000071246177, "_step": 145, "train_loss": 7.701875686645508}
 
1
+ {"global_step": 1000, "_timestamp": 1625837513.455174, "train_time": 4.0346198081970215, "train_learning_rate": 0.0003000000142492354, "_step": 156, "train_loss": 7.2498674392700195, "eval_accuracy": 0.0773010179400444, "eval_loss": 8.205772399902344}
wandb/run-20210709_132941-xrzp5klf/logs/debug-internal.log CHANGED
@@ -511,3 +511,54 @@
511
  2021-07-09 13:31:26,201 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
512
  2021-07-09 13:31:28,506 DEBUG HandlerThread:41762 [handler.py:handle_request():124] handle_request: stop_status
513
  2021-07-09 13:31:28,507 DEBUG SenderThread:41762 [sender.py:send_request():193] send_request: stop_status
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
511
  2021-07-09 13:31:26,201 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
512
  2021-07-09 13:31:28,506 DEBUG HandlerThread:41762 [handler.py:handle_request():124] handle_request: stop_status
513
  2021-07-09 13:31:28,507 DEBUG SenderThread:41762 [sender.py:send_request():193] send_request: stop_status
514
+ 2021-07-09 13:31:36,206 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
515
+ 2021-07-09 13:31:38,207 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
516
+ 2021-07-09 13:31:40,208 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
517
+ 2021-07-09 13:31:41,499 DEBUG SenderThread:41762 [sender.py:send():179] send: stats
518
+ 2021-07-09 13:31:42,209 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
519
+ 2021-07-09 13:31:43,556 DEBUG HandlerThread:41762 [handler.py:handle_request():124] handle_request: stop_status
520
+ 2021-07-09 13:31:43,556 DEBUG SenderThread:41762 [sender.py:send_request():193] send_request: stop_status
521
+ 2021-07-09 13:31:44,210 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
522
+ 2021-07-09 13:31:46,211 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
523
+ 2021-07-09 13:31:48,212 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
524
+ 2021-07-09 13:31:50,213 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
525
+ 2021-07-09 13:31:52,214 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
526
+ 2021-07-09 13:31:53,536 DEBUG SenderThread:41762 [sender.py:send():179] send: history
527
+ 2021-07-09 13:31:53,536 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
528
+ 2021-07-09 13:31:53,541 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
529
+ 2021-07-09 13:31:53,541 DEBUG SenderThread:41762 [sender.py:send():179] send: history
530
+ 2021-07-09 13:31:53,542 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
531
+ 2021-07-09 13:31:53,542 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
532
+ 2021-07-09 13:31:53,542 DEBUG SenderThread:41762 [sender.py:send():179] send: history
533
+ 2021-07-09 13:31:53,543 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
534
+ 2021-07-09 13:31:53,543 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
535
+ 2021-07-09 13:31:53,543 DEBUG SenderThread:41762 [sender.py:send():179] send: history
536
+ 2021-07-09 13:31:53,543 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
537
+ 2021-07-09 13:31:53,544 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
538
+ 2021-07-09 13:31:53,544 DEBUG SenderThread:41762 [sender.py:send():179] send: history
539
+ 2021-07-09 13:31:53,544 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
540
+ 2021-07-09 13:31:53,544 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
541
+ 2021-07-09 13:31:53,544 DEBUG SenderThread:41762 [sender.py:send():179] send: history
542
+ 2021-07-09 13:31:53,545 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
543
+ 2021-07-09 13:31:53,545 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
544
+ 2021-07-09 13:31:53,545 DEBUG SenderThread:41762 [sender.py:send():179] send: history
545
+ 2021-07-09 13:31:53,545 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
546
+ 2021-07-09 13:31:53,545 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
547
+ 2021-07-09 13:31:53,546 DEBUG SenderThread:41762 [sender.py:send():179] send: history
548
+ 2021-07-09 13:31:53,546 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
549
+ 2021-07-09 13:31:53,546 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
550
+ 2021-07-09 13:31:53,546 DEBUG SenderThread:41762 [sender.py:send():179] send: history
551
+ 2021-07-09 13:31:53,546 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
552
+ 2021-07-09 13:31:53,546 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
553
+ 2021-07-09 13:31:53,547 DEBUG SenderThread:41762 [sender.py:send():179] send: history
554
+ 2021-07-09 13:31:53,547 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
555
+ 2021-07-09 13:31:53,547 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
556
+ 2021-07-09 13:31:53,547 DEBUG SenderThread:41762 [sender.py:send():179] send: history
557
+ 2021-07-09 13:31:53,547 DEBUG SenderThread:41762 [sender.py:send():179] send: summary
558
+ 2021-07-09 13:31:53,548 INFO SenderThread:41762 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
559
+ 2021-07-09 13:31:54,215 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/events.out.tfevents.1625837383.t1v-n-112df4a9-w-0.40707.3.v2
560
+ 2021-07-09 13:31:54,216 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/wandb-summary.json
561
+ 2021-07-09 13:31:54,216 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
562
+ 2021-07-09 13:31:56,216 INFO Thread-8 :41762 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/nipunsadvilkar/sample/roberta-base-mr/wandb/run-20210709_132941-xrzp5klf/files/output.log
563
+ 2021-07-09 13:31:58,588 DEBUG HandlerThread:41762 [handler.py:handle_request():124] handle_request: stop_status
564
+ 2021-07-09 13:31:58,589 DEBUG SenderThread:41762 [sender.py:send_request():193] send_request: stop_status
wandb/run-20210709_132941-xrzp5klf/run-xrzp5klf.wandb CHANGED
Binary files a/wandb/run-20210709_132941-xrzp5klf/run-xrzp5klf.wandb and b/wandb/run-20210709_132941-xrzp5klf/run-xrzp5klf.wandb differ