/private/home/pfz/anaconda3/envs/ldm/bin/python
---Beginning program ---
No module 'xformers'. Proceeding without it.
__log__:{"train_dir": "/checkpoint/pfz/watermarking/data/coco_10k_orig", "val_dir": "/datasets01/COCO/060817/test2014/", "ldm_config": "/checkpoint/pfz/autoencoders/sd/stable-diffusion-2-1/v2-inference.yaml", "ldm_ckpt": "/checkpoint/pfz/autoencoders/sd/stable-diffusion-2-1-base/v2-1_512-ema-pruned.ckpt", "msg_decoder_path": "/checkpoint/pfz/watermarking/models/hidden/dec_48b_whit.torchscript.pt", "num_bits": 48, "redundancy": 1, "decoder_depth": 8, "decoder_channels": 64, "msg_mult": 10.0, "num_keys": 10, "batch_size": 4, "img_size": 256, "loss_i": "watson-vgg", "loss_w": "bce", "lambda_i": 0.2, "lambda_mse": 0.5, "lambda_lpips": 1, "lambda_w": 1.0, "optimizer": "AdamW,lr=5e-4", "steps": 100, "warmup_steps": 20, "log_freq": 10, "save_img_freq": 1000, "output_dir": "/checkpoint/pfz/2023_logs/0104_aisign_ftD_48b_all_ldms/_lambda_i=0.2_ldm_config=1_ldm_ckpt=1", "seed": 0, "debug": false}
>>> Building LDM model with config /checkpoint/pfz/autoencoders/sd/stable-diffusion-2-1/v2-inference.yaml and weights from /checkpoint/pfz/autoencoders/sd/stable-diffusion-2-1-base/v2-1_512-ema-pruned.ckpt...
Loading model from /checkpoint/pfz/autoencoders/sd/stable-diffusion-2-1-base/v2-1_512-ema-pruned.ckpt
Global Step: 220000
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 865.91 M params.
making attention of type 'vanilla' with 512 in_channels
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
making attention of type 'vanilla' with 512 in_channels
>>> Building hidden decoder with weights from /checkpoint/pfz/watermarking/models/hidden/dec_48b_whit.torchscript.pt...
>>> Loading data from /checkpoint/pfz/watermarking/data/coco_10k_orig and /datasets01/COCO/060817/test2014/...
>>> Creating losses...
Losses: bce and watson-vgg...
>>> Creating key with 48 bits...
Key: 111010110101000001010111010011010100010000100111
>>> Training...
Train [ 0/100] eta: 0:02:59 iteration: 0.000000 (0.000000) loss: 0.730529 (0.730529) loss_w: 0.730527 (0.730527) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.520833 (0.520833) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 1.794152 data: 0.455578 max mem: 10934
Train [ 10/100] eta: 0:01:25 iteration: 5.000000 (5.000000) loss: 0.655810 (0.659741) loss_w: 0.470606 (0.483642) loss_i: 0.892338 (0.880494) psnr: 40.351173 (inf) bit_acc_avg: 0.802083 (0.742898) word_acc_avg: 0.000000 (0.000000) lr: 0.000125 (0.000125) time: 0.945129 data: 0.041540 max mem: 11549
Train [ 20/100] eta: 0:01:03 iteration: 10.000000 (10.000000) loss: 0.577290 (0.613384) loss_w: 0.144738 (0.310548) loss_i: 1.911499 (1.514180) psnr: 31.930023 (inf) bit_acc_avg: 0.958333 (0.856151) word_acc_avg: 0.000000 (0.238095) lr: 0.000250 (0.000250) time: 0.739567 data: 0.000152 max mem: 11549
Train [ 30/100] eta: 0:00:51 iteration: 20.000000 (15.000000) loss: 0.582308 (0.613136) loss_w: 0.075537 (0.232229) loss_i: 2.511721 (1.904535) psnr: 29.659298 (inf) bit_acc_avg: 0.989583 (0.900706) word_acc_avg: 0.500000 (0.395161) lr: 0.000481 (0.000328) time: 0.619844 data: 0.000152 max mem: 11549
Train [ 40/100] eta: 0:00:42 iteration: 30.000000 (20.000000) loss: 0.615021 (0.614255) loss_w: 0.059773 (0.192286) loss_i: 2.702871 (2.109846) psnr: 29.079960 (inf) bit_acc_avg: 0.994792 (0.923145) word_acc_avg: 0.750000 (0.493902) lr: 0.000477 (0.000359) time: 0.621325 data: 0.000138 max mem: 11549
Train [ 50/100] eta: 0:00:34 iteration: 40.000000 (25.000000) loss: 0.611241 (0.611814) loss_w: 0.050448 (0.165350) loss_i: 2.736719 (2.232319) psnr: 29.225403 (inf) bit_acc_avg: 0.994792 (0.937704) word_acc_avg: 0.750000 (0.568627) lr: 0.000420 (0.000364) time: 0.622434 data: 0.000145 max mem: 11549
Train [ 60/100] eta: 0:00:27 iteration: 50.000000 (30.000000) loss: 0.580790 (0.603354) loss_w: 0.045575 (0.147938) loss_i: 2.563842 (2.277078) psnr: 28.819572 (inf) bit_acc_avg: 0.994792 (0.946721) word_acc_avg: 0.750000 (0.614754) lr: 0.000337 (0.000352) time: 0.623475 data: 0.000146 max mem: 11549
Train [ 70/100] eta: 0:00:20 iteration: 60.000000 (35.000000) loss: 0.545072 (0.596025) loss_w: 0.040465 (0.132894) loss_i: 2.512647 (2.315653) psnr: 28.706388 (inf) bit_acc_avg: 1.000000 (0.953639) word_acc_avg: 1.000000 (0.658451) lr: 0.000241 (0.000331) time: 0.624377 data: 0.000144 max mem: 11549
Train [ 80/100] eta: 0:00:13 iteration: 70.000000 (40.000000) loss: 0.529472 (0.585592) loss_w: 0.040465 (0.123000) loss_i: 2.395309 (2.312957) psnr: 29.178593 (inf) bit_acc_avg: 1.000000 (0.958848) word_acc_avg: 1.000000 (0.682099) lr: 0.000146 (0.000303) time: 0.624939 data: 0.000146 max mem: 11549
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.483272 (0.572580) loss_w: 0.039566 (0.114237) loss_i: 2.202292 (2.291717) psnr: 29.739288 (inf) bit_acc_avg: 1.000000 (0.962912) word_acc_avg: 1.000000 (0.706044) lr: 0.000067 (0.000274) time: 0.625777 data: 0.000146 max mem: 11549
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.474091 (0.564834) loss_w: 0.028266 (0.107252) loss_i: 2.202292 (2.287911) psnr: 29.108292 (inf) bit_acc_avg: 1.000000 (0.966094) word_acc_avg: 1.000000 (0.727500) lr: 0.000020 (0.000250) time: 0.625892 data: 0.000151 max mem: 11549
Train Total time: 0:01:05 (0.653026 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.474091 (0.564834) loss_w: 0.028266 (0.107252) loss_i: 2.202292 (2.287911) psnr: 29.108292 (inf) bit_acc_avg: 1.000000 (0.966094) word_acc_avg: 1.000000 (0.727500) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:35 iteration: 0.000000 (0.000000) psnr: 29.001421 (29.001421) bit_acc_none: 0.998698 (0.998698) word_acc_none: 0.937500 (0.937500) bit_acc_crop_01: 0.958333 (0.958333) word_acc_crop_01: 0.375000 (0.375000) bit_acc_crop_05: 0.996094 (0.996094) word_acc_crop_05: 0.875000 (0.875000) bit_acc_rot_25: 0.666667 (0.666667) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.441406 (0.441406) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.748698 (0.748698) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.983073 (0.983073) word_acc_resize_07: 0.437500 (0.437500) bit_acc_brightness_1p5: 0.986979 (0.986979) word_acc_brightness_1p5: 0.625000 (0.625000) bit_acc_brightness_2: 0.968750 (0.968750) word_acc_brightness_2: 0.312500 (0.312500) bit_acc_jpeg_80: 0.932292 (0.932292) word_acc_jpeg_80: 0.062500 (0.062500) bit_acc_jpeg_50: 0.885417 (0.885417) word_acc_jpeg_50: 0.000000 (0.000000) time: 5.115974 data: 0.497471 max mem: 11549
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 29.861334 (29.955219) bit_acc_none: 0.998698 (0.997396) word_acc_none: 0.937500 (0.892857) bit_acc_crop_01: 0.940104 (0.939546) word_acc_crop_01: 0.187500 (0.178571) bit_acc_crop_05: 0.994792 (0.993490) word_acc_crop_05: 0.812500 (0.776786) bit_acc_rot_25: 0.671875 (0.675781) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.464844 (0.465030) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.709635 (0.715960) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.979167 (0.979167) word_acc_resize_07: 0.437500 (0.446429) bit_acc_brightness_1p5: 0.990885 (0.991257) word_acc_brightness_1p5: 0.687500 (0.758929) bit_acc_brightness_2: 0.970052 (0.969494) word_acc_brightness_2: 0.312500 (0.366071) bit_acc_jpeg_80: 0.908854 (0.913690) word_acc_jpeg_80: 0.000000 (0.017857) bit_acc_jpeg_50: 0.852865 (0.852679) word_acc_jpeg_50: 0.000000 (0.000000) time: 1.934644 data: 0.071167 max mem: 11549
Eval Total time: 0:00:13 (1.700982 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 29.861334 (29.955219) bit_acc_none: 0.998698 (0.997396) word_acc_none: 0.937500 (0.892857) bit_acc_crop_01: 0.940104 (0.939546) word_acc_crop_01: 0.187500 (0.178571) bit_acc_crop_05: 0.994792 (0.993490) word_acc_crop_05: 0.812500 (0.776786) bit_acc_rot_25: 0.671875 (0.675781) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.464844 (0.465030) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.709635 (0.715960) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.979167 (0.979167) word_acc_resize_07: 0.437500 (0.446429) bit_acc_brightness_1p5: 0.990885 (0.991257) word_acc_brightness_1p5: 0.687500 (0.758929) bit_acc_brightness_2: 0.970052 (0.969494) word_acc_brightness_2: 0.312500 (0.366071) bit_acc_jpeg_80: 0.908854 (0.913690) word_acc_jpeg_80: 0.000000 (0.017857) bit_acc_jpeg_50: 0.852865 (0.852679) word_acc_jpeg_50: 0.000000 (0.000000)
>>> Creating key with 48 bits...
Key: 001000111110110110110100100100110001101100101000
>>> Training...
Train [ 0/100] eta: 0:01:24 iteration: 0.000000 (0.000000) loss: 0.793245 (0.793245) loss_w: 0.793243 (0.793243) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.468750 (0.468750) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 0.849167 data: 0.228625 max mem: 11555
Train [ 10/100] eta: 0:00:58 iteration: 5.000000 (5.000000) loss: 0.595777 (0.605792) loss_w: 0.471837 (0.449743) loss_i: 0.619699 (0.780246) psnr: 43.430889 (inf) bit_acc_avg: 0.833333 (0.776989) word_acc_avg: 0.000000 (0.045455) lr: 0.000125 (0.000125) time: 0.646061 data: 0.020914 max mem: 12119
Train [ 20/100] eta: 0:00:50 iteration: 10.000000 (10.000000) loss: 0.525425 (0.563044) loss_w: 0.155391 (0.273709) loss_i: 1.706736 (1.446675) psnr: 32.471497 (inf) bit_acc_avg: 0.973958 (0.878720) word_acc_avg: 0.250000 (0.345238) lr: 0.000250 (0.000250) time: 0.626100 data: 0.000146 max mem: 12119
Train [ 30/100] eta: 0:00:44 iteration: 20.000000 (15.000000) loss: 0.543895 (0.567319) loss_w: 0.052440 (0.205219) loss_i: 2.480518 (1.810502) psnr: 29.512346 (inf) bit_acc_avg: 0.994792 (0.916163) word_acc_avg: 0.750000 (0.500000) lr: 0.000481 (0.000328) time: 0.626538 data: 0.000150 max mem: 12119
Train [ 40/100] eta: 0:00:37 iteration: 30.000000 (20.000000) loss: 0.575339 (0.571743) loss_w: 0.048993 (0.164971) loss_i: 2.622705 (2.033857) psnr: 28.709059 (inf) bit_acc_avg: 0.994792 (0.935849) word_acc_avg: 0.750000 (0.597561) lr: 0.000477 (0.000359) time: 0.626896 data: 0.000148 max mem: 12119
Train [ 50/100] eta: 0:00:31 iteration: 40.000000 (25.000000) loss: 0.565343 (0.568617) loss_w: 0.034492 (0.141501) loss_i: 2.719597 (2.135579) psnr: 28.535765 (inf) bit_acc_avg: 1.000000 (0.947712) word_acc_avg: 1.000000 (0.651961) lr: 0.000420 (0.000364) time: 0.627212 data: 0.000150 max mem: 12119
Train [ 60/100] eta: 0:00:25 iteration: 50.000000 (30.000000) loss: 0.554556 (0.563258) loss_w: 0.023773 (0.122904) loss_i: 2.629088 (2.201771) psnr: 28.803949 (inf) bit_acc_avg: 1.000000 (0.955857) word_acc_avg: 1.000000 (0.696721) lr: 0.000337 (0.000352) time: 0.627686 data: 0.000153 max mem: 12119
Train [ 70/100] eta: 0:00:18 iteration: 60.000000 (35.000000) loss: 0.519340 (0.555323) loss_w: 0.023297 (0.111369) loss_i: 2.455521 (2.219768) psnr: 28.979832 (inf) bit_acc_avg: 1.000000 (0.961341) word_acc_avg: 1.000000 (0.721831) lr: 0.000241 (0.000331) time: 0.627894 data: 0.000147 max mem: 12119
Train [ 80/100] eta: 0:00:12 iteration: 70.000000 (40.000000) loss: 0.477291 (0.544884) loss_w: 0.023297 (0.101707) loss_i: 2.147840 (2.215886) psnr: 29.286566 (inf) bit_acc_avg: 1.000000 (0.965792) word_acc_avg: 1.000000 (0.746914) lr: 0.000146 (0.000303) time: 0.627332 data: 0.000141 max mem: 12119
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.471966 (0.536146) loss_w: 0.014621 (0.092667) loss_i: 2.155822 (2.217396) psnr: 28.945015 (inf) bit_acc_avg: 1.000000 (0.969380) word_acc_avg: 1.000000 (0.769231) lr: 0.000067 (0.000274) time: 0.627578 data: 0.000154 max mem: 12119
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.453382 (0.527367) loss_w: 0.012426 (0.086193) loss_i: 2.140549 (2.205869) psnr: 29.122669 (inf) bit_acc_avg: 1.000000 (0.972135) word_acc_avg: 1.000000 (0.790000) lr: 0.000020 (0.000250) time: 0.628454 data: 0.000159 max mem: 12119
Train Total time: 0:01:03 (0.624227 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.453382 (0.527367) loss_w: 0.012426 (0.086193) loss_i: 2.140549 (2.205869) psnr: 29.122669 (inf) bit_acc_avg: 1.000000 (0.972135) word_acc_avg: 1.000000 (0.790000) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:21 iteration: 0.000000 (0.000000) psnr: 28.803347 (28.803347) bit_acc_none: 0.998698 (0.998698) word_acc_none: 0.937500 (0.937500) bit_acc_crop_01: 0.964844 (0.964844) word_acc_crop_01: 0.250000 (0.250000) bit_acc_crop_05: 0.990885 (0.990885) word_acc_crop_05: 0.875000 (0.875000) bit_acc_rot_25: 0.583333 (0.583333) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.477865 (0.477865) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.675781 (0.675781) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.994792 (0.994792) word_acc_resize_07: 0.812500 (0.812500) bit_acc_brightness_1p5: 0.990885 (0.990885) word_acc_brightness_1p5: 0.812500 (0.812500) bit_acc_brightness_2: 0.977865 (0.977865) word_acc_brightness_2: 0.500000 (0.500000) bit_acc_jpeg_80: 0.977865 (0.977865) word_acc_jpeg_80: 0.312500 (0.312500) bit_acc_jpeg_50: 0.940104 (0.940104) word_acc_jpeg_50: 0.125000 (0.125000) time: 3.019792 data: 0.459830 max mem: 12119
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 29.658733 (29.714559) bit_acc_none: 0.998698 (0.999070) word_acc_none: 0.937500 (0.964286) bit_acc_crop_01: 0.947917 (0.950521) word_acc_crop_01: 0.250000 (0.303571) bit_acc_crop_05: 0.997396 (0.996652) word_acc_crop_05: 0.937500 (0.910714) bit_acc_rot_25: 0.583333 (0.574591) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.486979 (0.490513) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.674479 (0.674479) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.992188 (0.990141) word_acc_resize_07: 0.687500 (0.678571) bit_acc_brightness_1p5: 0.994792 (0.993490) word_acc_brightness_1p5: 0.937500 (0.866071) bit_acc_brightness_2: 0.984375 (0.979911) word_acc_brightness_2: 0.625000 (0.589286) bit_acc_jpeg_80: 0.971354 (0.968936) word_acc_jpeg_80: 0.312500 (0.312500) bit_acc_jpeg_50: 0.910156 (0.911830) word_acc_jpeg_50: 0.000000 (0.026786) time: 1.634944 data: 0.065781 max mem: 12119
Eval Total time: 0:00:11 (1.438792 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 29.658733 (29.714559) bit_acc_none: 0.998698 (0.999070) word_acc_none: 0.937500 (0.964286) bit_acc_crop_01: 0.947917 (0.950521) word_acc_crop_01: 0.250000 (0.303571) bit_acc_crop_05: 0.997396 (0.996652) word_acc_crop_05: 0.937500 (0.910714) bit_acc_rot_25: 0.583333 (0.574591) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.486979 (0.490513) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.674479 (0.674479) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.992188 (0.990141) word_acc_resize_07: 0.687500 (0.678571) bit_acc_brightness_1p5: 0.994792 (0.993490) word_acc_brightness_1p5: 0.937500 (0.866071) bit_acc_brightness_2: 0.984375 (0.979911) word_acc_brightness_2: 0.625000 (0.589286) bit_acc_jpeg_80: 0.971354 (0.968936) word_acc_jpeg_80: 0.312500 (0.312500) bit_acc_jpeg_50: 0.910156 (0.911830) word_acc_jpeg_50: 0.000000 (0.026786)
>>> Creating key with 48 bits...
Key: 110110001011100011001000001101000000001011001010
>>> Training...
Train [ 0/100] eta: 0:01:27 iteration: 0.000000 (0.000000) loss: 0.731553 (0.731553) loss_w: 0.731551 (0.731551) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.520833 (0.520833) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 0.873514 data: 0.247751 max mem: 12119
Train [ 10/100] eta: 0:00:58 iteration: 5.000000 (5.000000) loss: 0.660377 (0.645876) loss_w: 0.507589 (0.493411) loss_i: 0.763941 (0.762327) psnr: 39.707283 (inf) bit_acc_avg: 0.786458 (0.740057) word_acc_avg: 0.000000 (0.000000) lr: 0.000125 (0.000125) time: 0.649288 data: 0.022637 max mem: 12127
Train [ 20/100] eta: 0:00:51 iteration: 10.000000 (10.000000) loss: 0.606031 (0.637988) loss_w: 0.204080 (0.329712) loss_i: 1.712338 (1.541381) psnr: 32.711082 (inf) bit_acc_avg: 0.927083 (0.843006) word_acc_avg: 0.000000 (0.083333) lr: 0.000250 (0.000250) time: 0.627076 data: 0.000130 max mem: 12127
Train [ 30/100] eta: 0:00:44 iteration: 20.000000 (15.000000) loss: 0.626418 (0.636491) loss_w: 0.106067 (0.249334) loss_i: 2.646166 (1.935786) psnr: 29.834305 (inf) bit_acc_avg: 0.979167 (0.888609) word_acc_avg: 0.250000 (0.225806) lr: 0.000481 (0.000328) time: 0.627874 data: 0.000145 max mem: 12127
Train [ 40/100] eta: 0:00:38 iteration: 30.000000 (20.000000) loss: 0.647706 (0.638390) loss_w: 0.068510 (0.207146) loss_i: 2.832294 (2.156220) psnr: 28.012470 (inf) bit_acc_avg: 0.984375 (0.912729) word_acc_avg: 0.500000 (0.310976) lr: 0.000477 (0.000359) time: 0.628694 data: 0.000155 max mem: 12127
Train [ 50/100] eta: 0:00:31 iteration: 40.000000 (25.000000) loss: 0.624733 (0.632863) loss_w: 0.073126 (0.182436) loss_i: 2.739064 (2.252136) psnr: 28.164474 (inf) bit_acc_avg: 0.989583 (0.926777) word_acc_avg: 0.500000 (0.357843) lr: 0.000420 (0.000364) time: 0.628392 data: 0.000154 max mem: 12127
Train [ 60/100] eta: 0:00:25 iteration: 50.000000 (30.000000) loss: 0.579141 (0.623108) loss_w: 0.071000 (0.161253) loss_i: 2.590639 (2.309273) psnr: 28.164474 (inf) bit_acc_avg: 0.989583 (0.937671) word_acc_avg: 0.750000 (0.434426) lr: 0.000337 (0.000352) time: 0.628875 data: 0.000148 max mem: 12127
Train [ 70/100] eta: 0:00:18 iteration: 60.000000 (35.000000) loss: 0.565728 (0.614197) loss_w: 0.049510 (0.148014) loss_i: 2.531173 (2.330917) psnr: 28.328003 (inf) bit_acc_avg: 0.994792 (0.944909) word_acc_avg: 0.750000 (0.485915) lr: 0.000241 (0.000331) time: 0.629156 data: 0.000138 max mem: 12127
Train [ 80/100] eta: 0:00:12 iteration: 70.000000 (40.000000) loss: 0.515226 (0.600619) loss_w: 0.045651 (0.134723) loss_i: 2.383443 (2.329477) psnr: 28.592194 (inf) bit_acc_avg: 1.000000 (0.951518) word_acc_avg: 1.000000 (0.540123) lr: 0.000146 (0.000303) time: 0.629092 data: 0.000144 max mem: 12127
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.505313 (0.590933) loss_w: 0.036445 (0.124238) loss_i: 2.306699 (2.333473) psnr: 28.632580 (inf) bit_acc_avg: 1.000000 (0.956101) word_acc_avg: 1.000000 (0.574176) lr: 0.000067 (0.000274) time: 0.629436 data: 0.000146 max mem: 12127
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.481504 (0.579755) loss_w: 0.036445 (0.117002) loss_i: 2.201534 (2.313767) psnr: 28.650963 (inf) bit_acc_avg: 0.994792 (0.959635) word_acc_avg: 0.750000 (0.595000) lr: 0.000020 (0.000250) time: 0.629268 data: 0.000142 max mem: 12127
Train Total time: 0:01:03 (0.625578 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.481504 (0.579755) loss_w: 0.036445 (0.117002) loss_i: 2.201534 (2.313767) psnr: 28.650963 (inf) bit_acc_avg: 0.994792 (0.959635) word_acc_avg: 0.750000 (0.595000) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:21 iteration: 0.000000 (0.000000) psnr: 28.281399 (28.281399) bit_acc_none: 0.996094 (0.996094) word_acc_none: 0.875000 (0.875000) bit_acc_crop_01: 0.934896 (0.934896) word_acc_crop_01: 0.062500 (0.062500) bit_acc_crop_05: 0.984375 (0.984375) word_acc_crop_05: 0.625000 (0.625000) bit_acc_rot_25: 0.643229 (0.643229) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.477865 (0.477865) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.640625 (0.640625) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.958333 (0.958333) word_acc_resize_07: 0.062500 (0.062500) bit_acc_brightness_1p5: 0.984375 (0.984375) word_acc_brightness_1p5: 0.687500 (0.687500) bit_acc_brightness_2: 0.972656 (0.972656) word_acc_brightness_2: 0.500000 (0.500000) bit_acc_jpeg_80: 0.951823 (0.951823) word_acc_jpeg_80: 0.250000 (0.250000) bit_acc_jpeg_50: 0.901042 (0.901042) word_acc_jpeg_50: 0.000000 (0.000000) time: 3.000170 data: 0.442931 max mem: 12127
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 28.970741 (29.057049) bit_acc_none: 0.996094 (0.993490) word_acc_none: 0.812500 (0.857143) bit_acc_crop_01: 0.924479 (0.918527) word_acc_crop_01: 0.062500 (0.071429) bit_acc_crop_05: 0.984375 (0.986793) word_acc_crop_05: 0.687500 (0.678571) bit_acc_rot_25: 0.651042 (0.649368) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.477865 (0.474516) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.640625 (0.649182) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.964844 (0.961124) word_acc_resize_07: 0.125000 (0.125000) bit_acc_brightness_1p5: 0.984375 (0.987351) word_acc_brightness_1p5: 0.750000 (0.723214) bit_acc_brightness_2: 0.972656 (0.970424) word_acc_brightness_2: 0.500000 (0.464286) bit_acc_jpeg_80: 0.944010 (0.942150) word_acc_jpeg_80: 0.062500 (0.080357) bit_acc_jpeg_50: 0.877604 (0.881882) word_acc_jpeg_50: 0.000000 (0.000000) time: 1.638264 data: 0.063378 max mem: 12127
Eval Total time: 0:00:11 (1.441888 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 28.970741 (29.057049) bit_acc_none: 0.996094 (0.993490) word_acc_none: 0.812500 (0.857143) bit_acc_crop_01: 0.924479 (0.918527) word_acc_crop_01: 0.062500 (0.071429) bit_acc_crop_05: 0.984375 (0.986793) word_acc_crop_05: 0.687500 (0.678571) bit_acc_rot_25: 0.651042 (0.649368) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.477865 (0.474516) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.640625 (0.649182) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.964844 (0.961124) word_acc_resize_07: 0.125000 (0.125000) bit_acc_brightness_1p5: 0.984375 (0.987351) word_acc_brightness_1p5: 0.750000 (0.723214) bit_acc_brightness_2: 0.972656 (0.970424) word_acc_brightness_2: 0.500000 (0.464286) bit_acc_jpeg_80: 0.944010 (0.942150) word_acc_jpeg_80: 0.062500 (0.080357) bit_acc_jpeg_50: 0.877604 (0.881882) word_acc_jpeg_50: 0.000000 (0.000000)
>>> Creating key with 48 bits...
Key: 110010110000110100110101010001100010010101000011
>>> Training...
Train [ 0/100] eta: 0:01:25 iteration: 0.000000 (0.000000) loss: 0.756626 (0.756626) loss_w: 0.756624 (0.756624) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.463542 (0.463542) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 0.859437 data: 0.232846 max mem: 12127
Train [ 10/100] eta: 0:00:58 iteration: 5.000000 (5.000000) loss: 0.607788 (0.635901) loss_w: 0.418318 (0.470326) loss_i: 0.880916 (0.827874) psnr: 39.190750 (inf) bit_acc_avg: 0.822917 (0.747159) word_acc_avg: 0.000000 (0.000000) lr: 0.000125 (0.000125) time: 0.648257 data: 0.021289 max mem: 12127
Train [ 20/100] eta: 0:00:51 iteration: 10.000000 (10.000000) loss: 0.562696 (0.597609) loss_w: 0.196723 (0.291253) loss_i: 1.758315 (1.531783) psnr: 33.764679 (inf) bit_acc_avg: 0.958333 (0.861607) word_acc_avg: 0.000000 (0.297619) lr: 0.000250 (0.000250) time: 0.627888 data: 0.000142 max mem: 12127
Train [ 30/100] eta: 0:00:44 iteration: 20.000000 (15.000000) loss: 0.569366 (0.595203) loss_w: 0.056444 (0.216735) loss_i: 2.489091 (1.892340) psnr: 29.006128 (inf) bit_acc_avg: 0.989583 (0.902890) word_acc_avg: 0.750000 (0.419355) lr: 0.000481 (0.000328) time: 0.628824 data: 0.000142 max mem: 12127
Train [ 40/100] eta: 0:00:38 iteration: 30.000000 (20.000000) loss: 0.584322 (0.599402) loss_w: 0.043877 (0.176415) loss_i: 2.724898 (2.114934) psnr: 28.321608 (inf) bit_acc_avg: 0.994792 (0.924924) word_acc_avg: 0.750000 (0.506098) lr: 0.000477 (0.000359) time: 0.628765 data: 0.000148 max mem: 12127
Train [ 50/100] eta: 0:00:31 iteration: 40.000000 (25.000000) loss: 0.591154 (0.598466) loss_w: 0.040233 (0.149911) loss_i: 2.783554 (2.242772) psnr: 28.218882 (inf) bit_acc_avg: 0.994792 (0.938828) word_acc_avg: 0.750000 (0.573529) lr: 0.000420 (0.000364) time: 0.628644 data: 0.000155 max mem: 12127
Train [ 60/100] eta: 0:00:25 iteration: 50.000000 (30.000000) loss: 0.579765 (0.594603) loss_w: 0.036308 (0.131776) loss_i: 2.664538 (2.314137) psnr: 28.312969 (inf) bit_acc_avg: 1.000000 (0.948087) word_acc_avg: 1.000000 (0.618852) lr: 0.000337 (0.000352) time: 0.629003 data: 0.000142 max mem: 12127
Train [ 70/100] eta: 0:00:18 iteration: 60.000000 (35.000000) loss: 0.552013 (0.588272) loss_w: 0.031405 (0.119140) loss_i: 2.599780 (2.345657) psnr: 28.823994 (inf) bit_acc_avg: 1.000000 (0.954959) word_acc_avg: 1.000000 (0.661972) lr: 0.000241 (0.000331) time: 0.629600 data: 0.000153 max mem: 12127
Train [ 80/100] eta: 0:00:12 iteration: 70.000000 (40.000000) loss: 0.532435 (0.575599) loss_w: 0.036461 (0.109475) loss_i: 2.452829 (2.330622) psnr: 29.212097 (inf) bit_acc_avg: 1.000000 (0.960198) word_acc_avg: 1.000000 (0.688272) lr: 0.000146 (0.000303) time: 0.629646 data: 0.000159 max mem: 12127
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.466097 (0.564088) loss_w: 0.035497 (0.101810) loss_i: 2.168581 (2.311387) psnr: 29.763857 (inf) bit_acc_avg: 1.000000 (0.964114) word_acc_avg: 1.000000 (0.714286) lr: 0.000067 (0.000274) time: 0.629252 data: 0.000149 max mem: 12127
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.455519 (0.555094) loss_w: 0.031830 (0.095525) loss_i: 2.159801 (2.297841) psnr: 29.725140 (inf) bit_acc_avg: 1.000000 (0.967292) word_acc_avg: 1.000000 (0.737500) lr: 0.000020 (0.000250) time: 0.629277 data: 0.000148 max mem: 12127
Train Total time: 0:01:03 (0.625707 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.455519 (0.555094) loss_w: 0.031830 (0.095525) loss_i: 2.159801 (2.297841) psnr: 29.725140 (inf) bit_acc_avg: 1.000000 (0.967292) word_acc_avg: 1.000000 (0.737500) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:21 iteration: 0.000000 (0.000000) psnr: 28.829288 (28.829288) bit_acc_none: 0.998698 (0.998698) word_acc_none: 0.937500 (0.937500) bit_acc_crop_01: 0.963542 (0.963542) word_acc_crop_01: 0.125000 (0.125000) bit_acc_crop_05: 0.996094 (0.996094) word_acc_crop_05: 0.875000 (0.875000) bit_acc_rot_25: 0.687500 (0.687500) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.434896 (0.434896) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.641927 (0.641927) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.973958 (0.973958) word_acc_resize_07: 0.312500 (0.312500) bit_acc_brightness_1p5: 0.993490 (0.993490) word_acc_brightness_1p5: 0.875000 (0.875000) bit_acc_brightness_2: 0.992188 (0.992188) word_acc_brightness_2: 0.750000 (0.750000) bit_acc_jpeg_80: 0.963542 (0.963542) word_acc_jpeg_80: 0.125000 (0.125000) bit_acc_jpeg_50: 0.921875 (0.921875) word_acc_jpeg_50: 0.062500 (0.062500) time: 3.024267 data: 0.460299 max mem: 12127
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 29.567894 (29.675589) bit_acc_none: 0.998698 (0.998698) word_acc_none: 0.937500 (0.955357) bit_acc_crop_01: 0.938802 (0.939918) word_acc_crop_01: 0.125000 (0.205357) bit_acc_crop_05: 0.997396 (0.996280) word_acc_crop_05: 0.875000 (0.910714) bit_acc_rot_25: 0.686198 (0.683036) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.434896 (0.437872) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.660156 (0.657924) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.976562 (0.980283) word_acc_resize_07: 0.437500 (0.482143) bit_acc_brightness_1p5: 0.994792 (0.994978) word_acc_brightness_1p5: 0.937500 (0.892857) bit_acc_brightness_2: 0.986979 (0.981399) word_acc_brightness_2: 0.687500 (0.678571) bit_acc_jpeg_80: 0.951823 (0.950335) word_acc_jpeg_80: 0.125000 (0.116071) bit_acc_jpeg_50: 0.907552 (0.903646) word_acc_jpeg_50: 0.000000 (0.008929) time: 1.642749 data: 0.065850 max mem: 12127
Eval Total time: 0:00:11 (1.445654 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 29.567894 (29.675589) bit_acc_none: 0.998698 (0.998698) word_acc_none: 0.937500 (0.955357) bit_acc_crop_01: 0.938802 (0.939918) word_acc_crop_01: 0.125000 (0.205357) bit_acc_crop_05: 0.997396 (0.996280) word_acc_crop_05: 0.875000 (0.910714) bit_acc_rot_25: 0.686198 (0.683036) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.434896 (0.437872) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.660156 (0.657924) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.976562 (0.980283) word_acc_resize_07: 0.437500 (0.482143) bit_acc_brightness_1p5: 0.994792 (0.994978) word_acc_brightness_1p5: 0.937500 (0.892857) bit_acc_brightness_2: 0.986979 (0.981399) word_acc_brightness_2: 0.687500 (0.678571) bit_acc_jpeg_80: 0.951823 (0.950335) word_acc_jpeg_80: 0.125000 (0.116071) bit_acc_jpeg_50: 0.907552 (0.903646) word_acc_jpeg_50: 0.000000 (0.008929)
>>> Creating key with 48 bits...
Key: 000001011101100110111001000001010010001100100101
>>> Training...
Train [ 0/100] eta: 0:01:26 iteration: 0.000000 (0.000000) loss: 0.735352 (0.735352) loss_w: 0.735350 (0.735350) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.541667 (0.541667) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 0.869930 data: 0.243588 max mem: 12127
Train [ 10/100] eta: 0:00:58 iteration: 5.000000 (5.000000) loss: 0.560264 (0.601688) loss_w: 0.366557 (0.427128) loss_i: 0.862837 (0.872798) psnr: 38.320873 (inf) bit_acc_avg: 0.864583 (0.791193) word_acc_avg: 0.000000 (0.136364) lr: 0.000125 (0.000125) time: 0.649768 data: 0.022257 max mem: 12349
Train [ 20/100] eta: 0:00:51 iteration: 10.000000 (10.000000) loss: 0.559766 (0.586448) loss_w: 0.157618 (0.276170) loss_i: 1.829941 (1.551393) psnr: 32.677509 (inf) bit_acc_avg: 0.958333 (0.880704) word_acc_avg: 0.250000 (0.309524) lr: 0.000250 (0.000250) time: 0.627894 data: 0.000144 max mem: 12349
Train [ 30/100] eta: 0:00:44 iteration: 20.000000 (15.000000) loss: 0.592081 (0.597220) loss_w: 0.081419 (0.213358) loss_i: 2.604348 (1.919308) psnr: 29.065865 (inf) bit_acc_avg: 0.984375 (0.915491) word_acc_avg: 0.500000 (0.419355) lr: 0.000481 (0.000328) time: 0.629017 data: 0.000155 max mem: 12349
Train [ 40/100] eta: 0:00:38 iteration: 30.000000 (20.000000) loss: 0.614169 (0.607696) loss_w: 0.063990 (0.176308) loss_i: 2.811390 (2.156938) psnr: 28.571957 (inf) bit_acc_avg: 0.994792 (0.935086) word_acc_avg: 0.750000 (0.512195) lr: 0.000477 (0.000359) time: 0.629482 data: 0.000143 max mem: 12349
Train [ 50/100] eta: 0:00:31 iteration: 40.000000 (25.000000) loss: 0.610990 (0.610498) loss_w: 0.056167 (0.154047) loss_i: 2.854802 (2.282253) psnr: 28.378424 (inf) bit_acc_avg: 0.994792 (0.946078) word_acc_avg: 0.750000 (0.568627) lr: 0.000420 (0.000364) time: 0.629373 data: 0.000137 max mem: 12349
Train [ 60/100] eta: 0:00:25 iteration: 50.000000 (30.000000) loss: 0.609067 (0.609770) loss_w: 0.051269 (0.138028) loss_i: 2.759496 (2.358712) psnr: 28.378424 (inf) bit_acc_avg: 0.994792 (0.954320) word_acc_avg: 0.750000 (0.622951) lr: 0.000337 (0.000352) time: 0.629119 data: 0.000141 max mem: 12349
Train [ 70/100] eta: 0:00:18 iteration: 60.000000 (35.000000) loss: 0.579926 (0.600872) loss_w: 0.046731 (0.125110) loss_i: 2.589806 (2.378812) psnr: 28.698713 (inf) bit_acc_avg: 1.000000 (0.960387) word_acc_avg: 1.000000 (0.669014) lr: 0.000241 (0.000331) time: 0.628807 data: 0.000146 max mem: 12349
Train [ 80/100] eta: 0:00:12 iteration: 70.000000 (40.000000) loss: 0.514622 (0.589586) loss_w: 0.038010 (0.114301) loss_i: 2.390135 (2.376425) psnr: 28.856775 (inf) bit_acc_avg: 1.000000 (0.965021) word_acc_avg: 1.000000 (0.697531) lr: 0.000146 (0.000303) time: 0.629231 data: 0.000145 max mem: 12349
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.491588 (0.576411) loss_w: 0.038210 (0.106237) loss_i: 2.274854 (2.350871) psnr: 28.940588 (inf) bit_acc_avg: 1.000000 (0.968807) word_acc_avg: 1.000000 (0.728022) lr: 0.000067 (0.000274) time: 0.629359 data: 0.000144 max mem: 12349
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.476210 (0.568239) loss_w: 0.033908 (0.099941) loss_i: 2.203032 (2.341491) psnr: 29.395782 (inf) bit_acc_avg: 1.000000 (0.971563) word_acc_avg: 1.000000 (0.750000) lr: 0.000020 (0.000250) time: 0.629338 data: 0.000145 max mem: 12349
Train Total time: 0:01:03 (0.625945 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.476210 (0.568239) loss_w: 0.033908 (0.099941) loss_i: 2.203032 (2.341491) psnr: 29.395782 (inf) bit_acc_avg: 1.000000 (0.971563) word_acc_avg: 1.000000 (0.750000) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:21 iteration: 0.000000 (0.000000) psnr: 28.685741 (28.685741) bit_acc_none: 1.000000 (1.000000) word_acc_none: 1.000000 (1.000000) bit_acc_crop_01: 0.957031 (0.957031) word_acc_crop_01: 0.312500 (0.312500) bit_acc_crop_05: 0.993490 (0.993490) word_acc_crop_05: 0.750000 (0.750000) bit_acc_rot_25: 0.664062 (0.664062) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.473958 (0.473958) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.701823 (0.701823) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.993490 (0.993490) word_acc_resize_07: 0.750000 (0.750000) bit_acc_brightness_1p5: 0.990885 (0.990885) word_acc_brightness_1p5: 0.750000 (0.750000) bit_acc_brightness_2: 0.981771 (0.981771) word_acc_brightness_2: 0.500000 (0.500000) bit_acc_jpeg_80: 0.973958 (0.973958) word_acc_jpeg_80: 0.312500 (0.312500) bit_acc_jpeg_50: 0.928385 (0.928385) word_acc_jpeg_50: 0.000000 (0.000000) time: 3.012430 data: 0.429197 max mem: 12349
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 29.370369 (29.433050) bit_acc_none: 0.997396 (0.998140) word_acc_none: 0.937500 (0.919643) bit_acc_crop_01: 0.946615 (0.940848) word_acc_crop_01: 0.187500 (0.205357) bit_acc_crop_05: 0.994792 (0.994420) word_acc_crop_05: 0.812500 (0.848214) bit_acc_rot_25: 0.673177 (0.672619) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.501302 (0.499628) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.701823 (0.705543) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.985677 (0.986421) word_acc_resize_07: 0.625000 (0.633929) bit_acc_brightness_1p5: 0.993490 (0.991257) word_acc_brightness_1p5: 0.812500 (0.812500) bit_acc_brightness_2: 0.981771 (0.972470) word_acc_brightness_2: 0.500000 (0.464286) bit_acc_jpeg_80: 0.955729 (0.951637) word_acc_jpeg_80: 0.187500 (0.178571) bit_acc_jpeg_50: 0.907552 (0.908296) word_acc_jpeg_50: 0.000000 (0.017857) time: 1.642133 data: 0.061421 max mem: 12349
Eval Total time: 0:00:11 (1.445105 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 29.370369 (29.433050) bit_acc_none: 0.997396 (0.998140) word_acc_none: 0.937500 (0.919643) bit_acc_crop_01: 0.946615 (0.940848) word_acc_crop_01: 0.187500 (0.205357) bit_acc_crop_05: 0.994792 (0.994420) word_acc_crop_05: 0.812500 (0.848214) bit_acc_rot_25: 0.673177 (0.672619) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.501302 (0.499628) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.701823 (0.705543) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.985677 (0.986421) word_acc_resize_07: 0.625000 (0.633929) bit_acc_brightness_1p5: 0.993490 (0.991257) word_acc_brightness_1p5: 0.812500 (0.812500) bit_acc_brightness_2: 0.981771 (0.972470) word_acc_brightness_2: 0.500000 (0.464286) bit_acc_jpeg_80: 0.955729 (0.951637) word_acc_jpeg_80: 0.187500 (0.178571) bit_acc_jpeg_50: 0.907552 (0.908296) word_acc_jpeg_50: 0.000000 (0.017857)
>>> Creating key with 48 bits...
Key: 111001010011111101010111110111101000111101011101
>>> Training...
Train [ 0/100] eta: 0:01:29 iteration: 0.000000 (0.000000) loss: 0.780583 (0.780583) loss_w: 0.780581 (0.780581) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.505208 (0.505208) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 0.892227 data: 0.265005 max mem: 12349
Train [ 10/100] eta: 0:00:58 iteration: 5.000000 (5.000000) loss: 0.593135 (0.620309) loss_w: 0.409403 (0.467444) loss_i: 0.634556 (0.764321) psnr: 42.872128 (inf) bit_acc_avg: 0.864583 (0.773674) word_acc_avg: 0.000000 (0.022727) lr: 0.000125 (0.000125) time: 0.652307 data: 0.024207 max mem: 12353
Train [ 20/100] eta: 0:00:51 iteration: 10.000000 (10.000000) loss: 0.584593 (0.607961) loss_w: 0.213409 (0.333147) loss_i: 1.721167 (1.374069) psnr: 32.624775 (inf) bit_acc_avg: 0.927083 (0.851191) word_acc_avg: 0.000000 (0.011905) lr: 0.000250 (0.000250) time: 0.628656 data: 0.000140 max mem: 12353
Train [ 30/100] eta: 0:00:44 iteration: 20.000000 (15.000000) loss: 0.647697 (0.636599) loss_w: 0.184533 (0.280535) loss_i: 2.402087 (1.780320) psnr: 30.096121 (inf) bit_acc_avg: 0.937500 (0.879200) word_acc_avg: 0.000000 (0.016129) lr: 0.000481 (0.000328) time: 0.628731 data: 0.000146 max mem: 12353
Train [ 40/100] eta: 0:00:38 iteration: 30.000000 (20.000000) loss: 0.706496 (0.650736) loss_w: 0.146859 (0.249058) loss_i: 2.622277 (2.008391) psnr: 28.513355 (inf) bit_acc_avg: 0.947917 (0.897358) word_acc_avg: 0.000000 (0.018293) lr: 0.000477 (0.000359) time: 0.628628 data: 0.000137 max mem: 12353
Train [ 50/100] eta: 0:00:31 iteration: 40.000000 (25.000000) loss: 0.697638 (0.660888) loss_w: 0.130667 (0.224815) loss_i: 2.770222 (2.180366) psnr: 27.902193 (inf) bit_acc_avg: 0.953125 (0.907578) word_acc_avg: 0.000000 (0.019608) lr: 0.000420 (0.000364) time: 0.629276 data: 0.000142 max mem: 12353
Train [ 60/100] eta: 0:00:25 iteration: 50.000000 (30.000000) loss: 0.673491 (0.660233) loss_w: 0.119278 (0.206797) loss_i: 2.770222 (2.267180) psnr: 27.736866 (inf) bit_acc_avg: 0.953125 (0.916154) word_acc_avg: 0.000000 (0.016393) lr: 0.000337 (0.000352) time: 0.629368 data: 0.000150 max mem: 12353
Train [ 70/100] eta: 0:00:18 iteration: 60.000000 (35.000000) loss: 0.650706 (0.656040) loss_w: 0.109441 (0.194019) loss_i: 2.695328 (2.310108) psnr: 27.987736 (inf) bit_acc_avg: 0.958333 (0.922168) word_acc_avg: 0.000000 (0.017606) lr: 0.000241 (0.000331) time: 0.629208 data: 0.000152 max mem: 12353
Train [ 80/100] eta: 0:00:12 iteration: 70.000000 (40.000000) loss: 0.603080 (0.647495) loss_w: 0.108062 (0.184511) loss_i: 2.433167 (2.314920) psnr: 28.526880 (inf) bit_acc_avg: 0.958333 (0.927019) word_acc_avg: 0.000000 (0.021605) lr: 0.000146 (0.000303) time: 0.629511 data: 0.000145 max mem: 12353
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.563221 (0.637363) loss_w: 0.108113 (0.177315) loss_i: 2.207353 (2.300239) psnr: 28.543779 (inf) bit_acc_avg: 0.958333 (0.930861) word_acc_avg: 0.000000 (0.021978) lr: 0.000067 (0.000274) time: 0.630252 data: 0.000145 max mem: 12353
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.549999 (0.628777) loss_w: 0.108377 (0.171766) loss_i: 2.181958 (2.285054) psnr: 29.950726 (inf) bit_acc_avg: 0.963542 (0.933906) word_acc_avg: 0.000000 (0.030000) lr: 0.000020 (0.000250) time: 0.630225 data: 0.000149 max mem: 12353
Train Total time: 0:01:03 (0.626537 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.549999 (0.628777) loss_w: 0.108377 (0.171766) loss_i: 2.181958 (2.285054) psnr: 29.950726 (inf) bit_acc_avg: 0.963542 (0.933906) word_acc_avg: 0.000000 (0.030000) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:21 iteration: 0.000000 (0.000000) psnr: 28.941383 (28.941383) bit_acc_none: 0.957031 (0.957031) word_acc_none: 0.000000 (0.000000) bit_acc_crop_01: 0.886719 (0.886719) word_acc_crop_01: 0.000000 (0.000000) bit_acc_crop_05: 0.938802 (0.938802) word_acc_crop_05: 0.000000 (0.000000) bit_acc_rot_25: 0.622396 (0.622396) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.502604 (0.502604) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.751302 (0.751302) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.937500 (0.937500) word_acc_resize_07: 0.000000 (0.000000) bit_acc_brightness_1p5: 0.945312 (0.945312) word_acc_brightness_1p5: 0.000000 (0.000000) bit_acc_brightness_2: 0.927083 (0.927083) word_acc_brightness_2: 0.000000 (0.000000) bit_acc_jpeg_80: 0.921875 (0.921875) word_acc_jpeg_80: 0.000000 (0.000000) bit_acc_jpeg_50: 0.867188 (0.867188) word_acc_jpeg_50: 0.000000 (0.000000) time: 3.005334 data: 0.426308 max mem: 12353
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 29.518105 (29.810596) bit_acc_none: 0.963542 (0.962054) word_acc_none: 0.062500 (0.044643) bit_acc_crop_01: 0.880208 (0.876488) word_acc_crop_01: 0.000000 (0.000000) bit_acc_crop_05: 0.950521 (0.951079) word_acc_crop_05: 0.000000 (0.017857) bit_acc_rot_25: 0.623698 (0.623140) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.496094 (0.494420) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.746094 (0.745350) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.941406 (0.942522) word_acc_resize_07: 0.000000 (0.000000) bit_acc_brightness_1p5: 0.949219 (0.948103) word_acc_brightness_1p5: 0.000000 (0.017857) bit_acc_brightness_2: 0.927083 (0.929315) word_acc_brightness_2: 0.000000 (0.000000) bit_acc_jpeg_80: 0.914062 (0.914063) word_acc_jpeg_80: 0.000000 (0.000000) bit_acc_jpeg_50: 0.865885 (0.859375) word_acc_jpeg_50: 0.000000 (0.000000) time: 1.633120 data: 0.060993 max mem: 12353
Eval Total time: 0:00:11 (1.437118 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 29.518105 (29.810596) bit_acc_none: 0.963542 (0.962054) word_acc_none: 0.062500 (0.044643) bit_acc_crop_01: 0.880208 (0.876488) word_acc_crop_01: 0.000000 (0.000000) bit_acc_crop_05: 0.950521 (0.951079) word_acc_crop_05: 0.000000 (0.017857) bit_acc_rot_25: 0.623698 (0.623140) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.496094 (0.494420) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.746094 (0.745350) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.941406 (0.942522) word_acc_resize_07: 0.000000 (0.000000) bit_acc_brightness_1p5: 0.949219 (0.948103) word_acc_brightness_1p5: 0.000000 (0.017857) bit_acc_brightness_2: 0.927083 (0.929315) word_acc_brightness_2: 0.000000 (0.000000) bit_acc_jpeg_80: 0.914062 (0.914063) word_acc_jpeg_80: 0.000000 (0.000000) bit_acc_jpeg_50: 0.865885 (0.859375) word_acc_jpeg_50: 0.000000 (0.000000)
>>> Creating key with 48 bits...
Key: 011101001100011000110110001101111110001110111101
>>> Training...
Train [ 0/100] eta: 0:01:25 iteration: 0.000000 (0.000000) loss: 0.696767 (0.696767) loss_w: 0.696765 (0.696765) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.567708 (0.567708) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 0.855182 data: 0.229867 max mem: 12353
Train [ 10/100] eta: 0:00:58 iteration: 5.000000 (5.000000) loss: 0.612257 (0.616240) loss_w: 0.481102 (0.464041) loss_i: 0.655772 (0.760996) psnr: 42.616577 (inf) bit_acc_avg: 0.807292 (0.779356) word_acc_avg: 0.000000 (0.022727) lr: 0.000125 (0.000125) time: 0.649383 data: 0.021025 max mem: 12772
Train [ 20/100] eta: 0:00:51 iteration: 10.000000 (10.000000) loss: 0.599305 (0.604104) loss_w: 0.187728 (0.317659) loss_i: 1.640589 (1.432228) psnr: 32.418896 (inf) bit_acc_avg: 0.937500 (0.864831) word_acc_avg: 0.000000 (0.083333) lr: 0.000250 (0.000250) time: 0.628574 data: 0.000147 max mem: 12772
Train [ 30/100] eta: 0:00:44 iteration: 20.000000 (15.000000) loss: 0.618004 (0.619785) loss_w: 0.121316 (0.246564) loss_i: 2.474327 (1.866104) psnr: 29.755140 (inf) bit_acc_avg: 0.968750 (0.899194) word_acc_avg: 0.000000 (0.096774) lr: 0.000481 (0.000328) time: 0.628991 data: 0.000148 max mem: 12772
Train [ 40/100] eta: 0:00:38 iteration: 30.000000 (20.000000) loss: 0.669930 (0.634306) loss_w: 0.091803 (0.214489) loss_i: 2.705717 (2.099084) psnr: 28.314327 (inf) bit_acc_avg: 0.968750 (0.915650) word_acc_avg: 0.000000 (0.115854) lr: 0.000477 (0.000359) time: 0.629656 data: 0.000145 max mem: 12772
Train [ 50/100] eta: 0:00:31 iteration: 40.000000 (25.000000) loss: 0.652476 (0.634877) loss_w: 0.090186 (0.188819) loss_i: 2.696591 (2.230290) psnr: 27.876188 (inf) bit_acc_avg: 0.979167 (0.929841) word_acc_avg: 0.250000 (0.196078) lr: 0.000420 (0.000364) time: 0.629877 data: 0.000149 max mem: 12772
Train [ 60/100] eta: 0:00:25 iteration: 50.000000 (30.000000) loss: 0.623786 (0.628561) loss_w: 0.074889 (0.170416) loss_i: 2.682348 (2.290725) psnr: 28.107309 (inf) bit_acc_avg: 0.989583 (0.939293) word_acc_avg: 0.500000 (0.258197) lr: 0.000337 (0.000352) time: 0.629631 data: 0.000150 max mem: 12772
Train [ 70/100] eta: 0:00:18 iteration: 60.000000 (35.000000) loss: 0.565550 (0.618322) loss_w: 0.065130 (0.155630) loss_i: 2.449833 (2.313462) psnr: 28.510904 (inf) bit_acc_avg: 0.994792 (0.946743) word_acc_avg: 0.750000 (0.316901) lr: 0.000241 (0.000331) time: 0.629073 data: 0.000149 max mem: 12772
Train [ 80/100] eta: 0:00:12 iteration: 70.000000 (40.000000) loss: 0.541049 (0.607794) loss_w: 0.058989 (0.144108) loss_i: 2.419859 (2.318433) psnr: 28.539152 (inf) bit_acc_avg: 0.994792 (0.952353) word_acc_avg: 0.750000 (0.373457) lr: 0.000146 (0.000303) time: 0.629496 data: 0.000150 max mem: 12772
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.519113 (0.595867) loss_w: 0.055353 (0.135218) loss_i: 2.313696 (2.303244) psnr: 28.743126 (inf) bit_acc_avg: 0.994792 (0.956845) word_acc_avg: 0.750000 (0.414835) lr: 0.000067 (0.000274) time: 0.629993 data: 0.000167 max mem: 12772
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.509029 (0.586211) loss_w: 0.052178 (0.127808) loss_i: 2.207304 (2.292015) psnr: 28.691210 (inf) bit_acc_avg: 0.994792 (0.960208) word_acc_avg: 0.750000 (0.442500) lr: 0.000020 (0.000250) time: 0.630245 data: 0.000166 max mem: 12772
Train Total time: 0:01:03 (0.626271 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.509029 (0.586211) loss_w: 0.052178 (0.127808) loss_i: 2.207304 (2.292015) psnr: 28.691210 (inf) bit_acc_avg: 0.994792 (0.960208) word_acc_avg: 0.750000 (0.442500) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:21 iteration: 0.000000 (0.000000) psnr: 28.689491 (28.689491) bit_acc_none: 0.992188 (0.992188) word_acc_none: 0.687500 (0.687500) bit_acc_crop_01: 0.928385 (0.928385) word_acc_crop_01: 0.062500 (0.062500) bit_acc_crop_05: 0.988281 (0.988281) word_acc_crop_05: 0.562500 (0.562500) bit_acc_rot_25: 0.625000 (0.625000) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.404948 (0.404948) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.697917 (0.697917) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.968750 (0.968750) word_acc_resize_07: 0.250000 (0.250000) bit_acc_brightness_1p5: 0.990885 (0.990885) word_acc_brightness_1p5: 0.687500 (0.687500) bit_acc_brightness_2: 0.976562 (0.976562) word_acc_brightness_2: 0.187500 (0.187500) bit_acc_jpeg_80: 0.927083 (0.927083) word_acc_jpeg_80: 0.000000 (0.000000) bit_acc_jpeg_50: 0.897135 (0.897135) word_acc_jpeg_50: 0.000000 (0.000000) time: 3.000573 data: 0.434785 max mem: 12772
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 29.337574 (29.493725) bit_acc_none: 0.989583 (0.990885) word_acc_none: 0.625000 (0.660714) bit_acc_crop_01: 0.921875 (0.920201) word_acc_crop_01: 0.062500 (0.071429) bit_acc_crop_05: 0.984375 (0.983817) word_acc_crop_05: 0.437500 (0.419643) bit_acc_rot_25: 0.625000 (0.623698) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.404948 (0.404576) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.691406 (0.688058) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.968750 (0.966518) word_acc_resize_07: 0.187500 (0.223214) bit_acc_brightness_1p5: 0.984375 (0.986235) word_acc_brightness_1p5: 0.562500 (0.562500) bit_acc_brightness_2: 0.975260 (0.965030) word_acc_brightness_2: 0.375000 (0.294643) bit_acc_jpeg_80: 0.919271 (0.918155) word_acc_jpeg_80: 0.000000 (0.000000) bit_acc_jpeg_50: 0.871094 (0.875744) word_acc_jpeg_50: 0.000000 (0.000000) time: 1.639330 data: 0.062204 max mem: 12772
Eval Total time: 0:00:11 (1.442589 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 29.337574 (29.493725) bit_acc_none: 0.989583 (0.990885) word_acc_none: 0.625000 (0.660714) bit_acc_crop_01: 0.921875 (0.920201) word_acc_crop_01: 0.062500 (0.071429) bit_acc_crop_05: 0.984375 (0.983817) word_acc_crop_05: 0.437500 (0.419643) bit_acc_rot_25: 0.625000 (0.623698) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.404948 (0.404576) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.691406 (0.688058) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.968750 (0.966518) word_acc_resize_07: 0.187500 (0.223214) bit_acc_brightness_1p5: 0.984375 (0.986235) word_acc_brightness_1p5: 0.562500 (0.562500) bit_acc_brightness_2: 0.975260 (0.965030) word_acc_brightness_2: 0.375000 (0.294643) bit_acc_jpeg_80: 0.919271 (0.918155) word_acc_jpeg_80: 0.000000 (0.000000) bit_acc_jpeg_50: 0.871094 (0.875744) word_acc_jpeg_50: 0.000000 (0.000000)
>>> Creating key with 48 bits...
Key: 111111100001011110110001111000101100000011001100
>>> Training...
Train [ 0/100] eta: 0:01:25 iteration: 0.000000 (0.000000) loss: 0.724550 (0.724550) loss_w: 0.724548 (0.724548) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.531250 (0.531250) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 0.859240 data: 0.234874 max mem: 12772
Train [ 10/100] eta: 0:00:58 iteration: 5.000000 (5.000000) loss: 0.606178 (0.605067) loss_w: 0.510448 (0.447753) loss_i: 0.653699 (0.786571) psnr: 44.558262 (inf) bit_acc_avg: 0.817708 (0.770833) word_acc_avg: 0.000000 (0.090909) lr: 0.000125 (0.000125) time: 0.649146 data: 0.021476 max mem: 12793
Train [ 20/100] eta: 0:00:51 iteration: 10.000000 (10.000000) loss: 0.529414 (0.567122) loss_w: 0.089626 (0.268547) loss_i: 1.945016 (1.492879) psnr: 31.516575 (inf) bit_acc_avg: 0.989583 (0.877232) word_acc_avg: 0.500000 (0.416667) lr: 0.000250 (0.000250) time: 0.628888 data: 0.000140 max mem: 12793
Train [ 30/100] eta: 0:00:44 iteration: 20.000000 (15.000000) loss: 0.549358 (0.570850) loss_w: 0.049458 (0.195185) loss_i: 2.387662 (1.878323) psnr: 29.565243 (inf) bit_acc_avg: 0.994792 (0.916163) word_acc_avg: 0.750000 (0.572581) lr: 0.000481 (0.000328) time: 0.629903 data: 0.000138 max mem: 12793
Train [ 40/100] eta: 0:00:38 iteration: 30.000000 (20.000000) loss: 0.582331 (0.577266) loss_w: 0.033562 (0.158113) loss_i: 2.665742 (2.095767) psnr: 28.620468 (inf) bit_acc_avg: 1.000000 (0.935849) word_acc_avg: 1.000000 (0.646341) lr: 0.000477 (0.000359) time: 0.630160 data: 0.000140 max mem: 12793
Train [ 50/100] eta: 0:00:31 iteration: 40.000000 (25.000000) loss: 0.594989 (0.579283) loss_w: 0.033562 (0.134853) loss_i: 2.727694 (2.222147) psnr: 28.032310 (inf) bit_acc_avg: 1.000000 (0.948019) word_acc_avg: 1.000000 (0.700980) lr: 0.000420 (0.000364) time: 0.629983 data: 0.000147 max mem: 12793
Train [ 60/100] eta: 0:00:25 iteration: 50.000000 (30.000000) loss: 0.570572 (0.576148) loss_w: 0.032308 (0.118608) loss_i: 2.675216 (2.287701) psnr: 27.874216 (inf) bit_acc_avg: 1.000000 (0.956284) word_acc_avg: 1.000000 (0.741803) lr: 0.000337 (0.000352) time: 0.629619 data: 0.000141 max mem: 12793
Train [ 70/100] eta: 0:00:18 iteration: 60.000000 (35.000000) loss: 0.548276 (0.567551) loss_w: 0.030475 (0.108094) loss_i: 2.452588 (2.297286) psnr: 28.848597 (inf) bit_acc_avg: 1.000000 (0.961414) word_acc_avg: 1.000000 (0.750000) lr: 0.000241 (0.000331) time: 0.629537 data: 0.000142 max mem: 12793
Train [ 80/100] eta: 0:00:12 iteration: 70.000000 (40.000000) loss: 0.499489 (0.558303) loss_w: 0.030475 (0.099450) loss_i: 2.346977 (2.294264) psnr: 28.976706 (inf) bit_acc_avg: 0.994792 (0.965856) word_acc_avg: 0.750000 (0.765432) lr: 0.000146 (0.000303) time: 0.629986 data: 0.000143 max mem: 12793
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.474749 (0.548190) loss_w: 0.040416 (0.092585) loss_i: 2.181081 (2.278024) psnr: 29.906569 (inf) bit_acc_avg: 1.000000 (0.969151) word_acc_avg: 1.000000 (0.777473) lr: 0.000067 (0.000274) time: 0.630135 data: 0.000136 max mem: 12793
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.445124 (0.538651) loss_w: 0.037854 (0.087124) loss_i: 2.048141 (2.257634) psnr: 30.151297 (inf) bit_acc_avg: 1.000000 (0.971563) word_acc_avg: 1.000000 (0.792500) lr: 0.000020 (0.000250) time: 0.630086 data: 0.000145 max mem: 12793
Train Total time: 0:01:03 (0.626548 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.445124 (0.538651) loss_w: 0.037854 (0.087124) loss_i: 2.048141 (2.257634) psnr: 30.151297 (inf) bit_acc_avg: 1.000000 (0.971563) word_acc_avg: 1.000000 (0.792500) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:21 iteration: 0.000000 (0.000000) psnr: 28.948586 (28.948586) bit_acc_none: 0.997396 (0.997396) word_acc_none: 0.937500 (0.937500) bit_acc_crop_01: 0.937500 (0.937500) word_acc_crop_01: 0.125000 (0.125000) bit_acc_crop_05: 0.997396 (0.997396) word_acc_crop_05: 0.875000 (0.875000) bit_acc_rot_25: 0.662760 (0.662760) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.434896 (0.434896) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.618490 (0.618490) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.984375 (0.984375) word_acc_resize_07: 0.687500 (0.687500) bit_acc_brightness_1p5: 0.988281 (0.988281) word_acc_brightness_1p5: 0.875000 (0.875000) bit_acc_brightness_2: 0.971354 (0.971354) word_acc_brightness_2: 0.375000 (0.375000) bit_acc_jpeg_80: 0.929688 (0.929688) word_acc_jpeg_80: 0.062500 (0.062500) bit_acc_jpeg_50: 0.904948 (0.904948) word_acc_jpeg_50: 0.000000 (0.000000) time: 3.030729 data: 0.421628 max mem: 12793
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 29.664309 (29.835129) bit_acc_none: 0.998698 (0.998326) word_acc_none: 0.937500 (0.955357) bit_acc_crop_01: 0.937500 (0.944196) word_acc_crop_01: 0.250000 (0.258929) bit_acc_crop_05: 0.997396 (0.996838) word_acc_crop_05: 0.875000 (0.910714) bit_acc_rot_25: 0.669271 (0.666853) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.434896 (0.439360) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.625000 (0.626302) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.984375 (0.982143) word_acc_resize_07: 0.500000 (0.517857) bit_acc_brightness_1p5: 0.994792 (0.994048) word_acc_brightness_1p5: 0.875000 (0.883929) bit_acc_brightness_2: 0.976562 (0.973958) word_acc_brightness_2: 0.500000 (0.526786) bit_acc_jpeg_80: 0.929688 (0.924293) word_acc_jpeg_80: 0.000000 (0.008929) bit_acc_jpeg_50: 0.894531 (0.887649) word_acc_jpeg_50: 0.000000 (0.000000) time: 1.668116 data: 0.060347 max mem: 12793
Eval Total time: 0:00:11 (1.468234 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 29.664309 (29.835129) bit_acc_none: 0.998698 (0.998326) word_acc_none: 0.937500 (0.955357) bit_acc_crop_01: 0.937500 (0.944196) word_acc_crop_01: 0.250000 (0.258929) bit_acc_crop_05: 0.997396 (0.996838) word_acc_crop_05: 0.875000 (0.910714) bit_acc_rot_25: 0.669271 (0.666853) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.434896 (0.439360) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.625000 (0.626302) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.984375 (0.982143) word_acc_resize_07: 0.500000 (0.517857) bit_acc_brightness_1p5: 0.994792 (0.994048) word_acc_brightness_1p5: 0.875000 (0.883929) bit_acc_brightness_2: 0.976562 (0.973958) word_acc_brightness_2: 0.500000 (0.526786) bit_acc_jpeg_80: 0.929688 (0.924293) word_acc_jpeg_80: 0.000000 (0.008929) bit_acc_jpeg_50: 0.894531 (0.887649) word_acc_jpeg_50: 0.000000 (0.000000)
>>> Creating key with 48 bits...
Key: 010101111101111100111010101110111110110011101011
>>> Training...
Train [ 0/100] eta: 0:01:26 iteration: 0.000000 (0.000000) loss: 0.741137 (0.741137) loss_w: 0.741135 (0.741135) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.494792 (0.494792) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 0.860302 data: 0.233264 max mem: 12793
Train [ 10/100] eta: 0:00:58 iteration: 5.000000 (5.000000) loss: 0.657372 (0.628727) loss_w: 0.496834 (0.478516) loss_i: 0.802689 (0.751055) psnr: 40.503685 (inf) bit_acc_avg: 0.791667 (0.751894) word_acc_avg: 0.000000 (0.068182) lr: 0.000125 (0.000125) time: 0.648898 data: 0.021322 max mem: 12793
Train [ 20/100] eta: 0:00:51 iteration: 10.000000 (10.000000) loss: 0.540297 (0.588562) loss_w: 0.127136 (0.291827) loss_i: 1.394867 (1.483673) psnr: 31.610870 (inf) bit_acc_avg: 0.947917 (0.863343) word_acc_avg: 0.250000 (0.392857) lr: 0.000250 (0.000250) time: 0.628667 data: 0.000131 max mem: 12793
Train [ 30/100] eta: 0:00:44 iteration: 20.000000 (15.000000) loss: 0.551689 (0.590056) loss_w: 0.070396 (0.217405) loss_i: 2.449965 (1.863255) psnr: 29.753254 (inf) bit_acc_avg: 0.989583 (0.905578) word_acc_avg: 0.750000 (0.532258) lr: 0.000481 (0.000328) time: 0.629762 data: 0.000134 max mem: 12793
Train [ 40/100] eta: 0:00:38 iteration: 30.000000 (20.000000) loss: 0.608581 (0.595846) loss_w: 0.046737 (0.173029) loss_i: 2.743184 (2.114081) psnr: 28.398279 (inf) bit_acc_avg: 1.000000 (0.928100) word_acc_avg: 1.000000 (0.621951) lr: 0.000477 (0.000359) time: 0.629958 data: 0.000134 max mem: 12793
Train [ 50/100] eta: 0:00:31 iteration: 40.000000 (25.000000) loss: 0.591951 (0.598005) loss_w: 0.035935 (0.150247) loss_i: 2.789580 (2.238794) psnr: 27.999310 (inf) bit_acc_avg: 1.000000 (0.941074) word_acc_avg: 1.000000 (0.666667) lr: 0.000420 (0.000364) time: 0.630031 data: 0.000140 max mem: 12793
Train [ 60/100] eta: 0:00:25 iteration: 50.000000 (30.000000) loss: 0.577516 (0.589992) loss_w: 0.034863 (0.131356) loss_i: 2.602789 (2.293180) psnr: 28.557936 (inf) bit_acc_avg: 1.000000 (0.950307) word_acc_avg: 1.000000 (0.704918) lr: 0.000337 (0.000352) time: 0.629815 data: 0.000141 max mem: 12793
Train [ 70/100] eta: 0:00:18 iteration: 60.000000 (35.000000) loss: 0.531526 (0.581335) loss_w: 0.027742 (0.117513) loss_i: 2.484543 (2.319110) psnr: 29.202599 (inf) bit_acc_avg: 1.000000 (0.956866) word_acc_avg: 1.000000 (0.732394) lr: 0.000241 (0.000331) time: 0.629787 data: 0.000145 max mem: 12793
Train [ 80/100] eta: 0:00:12 iteration: 70.000000 (40.000000) loss: 0.513635 (0.569433) loss_w: 0.026859 (0.107248) loss_i: 2.399645 (2.310928) psnr: 29.351559 (inf) bit_acc_avg: 1.000000 (0.961934) word_acc_avg: 1.000000 (0.753086) lr: 0.000146 (0.000303) time: 0.630014 data: 0.000144 max mem: 12793
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.475228 (0.559157) loss_w: 0.026789 (0.099216) loss_i: 2.189246 (2.299703) psnr: 29.534784 (inf) bit_acc_avg: 1.000000 (0.965888) word_acc_avg: 1.000000 (0.771978) lr: 0.000067 (0.000274) time: 0.629821 data: 0.000132 max mem: 12793
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.464427 (0.550068) loss_w: 0.031409 (0.094410) loss_i: 2.090561 (2.278292) psnr: 29.773483 (inf) bit_acc_avg: 1.000000 (0.968646) word_acc_avg: 1.000000 (0.787500) lr: 0.000020 (0.000250) time: 0.630156 data: 0.000139 max mem: 12793
Train Total time: 0:01:03 (0.626513 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.464427 (0.550068) loss_w: 0.031409 (0.094410) loss_i: 2.090561 (2.278292) psnr: 29.773483 (inf) bit_acc_avg: 1.000000 (0.968646) word_acc_avg: 1.000000 (0.787500) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:21 iteration: 0.000000 (0.000000) psnr: 29.016727 (29.016727) bit_acc_none: 0.998698 (0.998698) word_acc_none: 0.937500 (0.937500) bit_acc_crop_01: 0.953125 (0.953125) word_acc_crop_01: 0.250000 (0.250000) bit_acc_crop_05: 0.990885 (0.990885) word_acc_crop_05: 0.875000 (0.875000) bit_acc_rot_25: 0.739583 (0.739583) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.410156 (0.410156) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.621094 (0.621094) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.967448 (0.967448) word_acc_resize_07: 0.125000 (0.125000) bit_acc_brightness_1p5: 0.992188 (0.992188) word_acc_brightness_1p5: 0.875000 (0.875000) bit_acc_brightness_2: 0.984375 (0.984375) word_acc_brightness_2: 0.687500 (0.687500) bit_acc_jpeg_80: 0.957031 (0.957031) word_acc_jpeg_80: 0.125000 (0.125000) bit_acc_jpeg_50: 0.893229 (0.893229) word_acc_jpeg_50: 0.000000 (0.000000) time: 3.067913 data: 0.489593 max mem: 12793
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 29.826435 (29.908539) bit_acc_none: 0.998698 (0.997768) word_acc_none: 0.937500 (0.919643) bit_acc_crop_01: 0.946615 (0.941034) word_acc_crop_01: 0.187500 (0.187500) bit_acc_crop_05: 0.994792 (0.994792) word_acc_crop_05: 0.875000 (0.857143) bit_acc_rot_25: 0.725260 (0.723958) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.410156 (0.408668) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.643229 (0.638207) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.967448 (0.964658) word_acc_resize_07: 0.187500 (0.178571) bit_acc_brightness_1p5: 0.997396 (0.994234) word_acc_brightness_1p5: 0.875000 (0.892857) bit_acc_brightness_2: 0.984375 (0.977307) word_acc_brightness_2: 0.687500 (0.633929) bit_acc_jpeg_80: 0.946615 (0.942336) word_acc_jpeg_80: 0.062500 (0.071429) bit_acc_jpeg_50: 0.889323 (0.882626) word_acc_jpeg_50: 0.000000 (0.000000) time: 1.645525 data: 0.070039 max mem: 12793
Eval Total time: 0:00:11 (1.448079 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 29.826435 (29.908539) bit_acc_none: 0.998698 (0.997768) word_acc_none: 0.937500 (0.919643) bit_acc_crop_01: 0.946615 (0.941034) word_acc_crop_01: 0.187500 (0.187500) bit_acc_crop_05: 0.994792 (0.994792) word_acc_crop_05: 0.875000 (0.857143) bit_acc_rot_25: 0.725260 (0.723958) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.410156 (0.408668) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.643229 (0.638207) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.967448 (0.964658) word_acc_resize_07: 0.187500 (0.178571) bit_acc_brightness_1p5: 0.997396 (0.994234) word_acc_brightness_1p5: 0.875000 (0.892857) bit_acc_brightness_2: 0.984375 (0.977307) word_acc_brightness_2: 0.687500 (0.633929) bit_acc_jpeg_80: 0.946615 (0.942336) word_acc_jpeg_80: 0.062500 (0.071429) bit_acc_jpeg_50: 0.889323 (0.882626) word_acc_jpeg_50: 0.000000 (0.000000)
>>> Creating key with 48 bits...
Key: 000110010111000011100111010011011010011001010001
>>> Training...
Train [ 0/100] eta: 0:01:25 iteration: 0.000000 (0.000000) loss: 0.722341 (0.722341) loss_w: 0.722339 (0.722339) loss_i: 0.000010 (0.000010) psnr: inf (inf) bit_acc_avg: 0.552083 (0.552083) word_acc_avg: 0.000000 (0.000000) lr: 0.000000 (0.000000) time: 0.856231 data: 0.230004 max mem: 12793
Train [ 10/100] eta: 0:00:58 iteration: 5.000000 (5.000000) loss: 0.617323 (0.618174) loss_w: 0.490728 (0.472204) loss_i: 0.632972 (0.729851) psnr: 44.017998 (inf) bit_acc_avg: 0.838542 (0.772727) word_acc_avg: 0.000000 (0.045455) lr: 0.000125 (0.000125) time: 0.649612 data: 0.021043 max mem: 12793
Train [ 20/100] eta: 0:00:51 iteration: 10.000000 (10.000000) loss: 0.534040 (0.573133) loss_w: 0.132669 (0.291289) loss_i: 1.677645 (1.409219) psnr: 32.643402 (inf) bit_acc_avg: 0.968750 (0.875248) word_acc_avg: 0.250000 (0.297619) lr: 0.000250 (0.000250) time: 0.629423 data: 0.000154 max mem: 12793
Train [ 30/100] eta: 0:00:44 iteration: 20.000000 (15.000000) loss: 0.552013 (0.581403) loss_w: 0.070880 (0.215035) loss_i: 2.446477 (1.831842) psnr: 29.638889 (inf) bit_acc_avg: 0.994792 (0.914483) word_acc_avg: 0.750000 (0.483871) lr: 0.000481 (0.000328) time: 0.629347 data: 0.000166 max mem: 12793
Train [ 40/100] eta: 0:00:38 iteration: 30.000000 (20.000000) loss: 0.588294 (0.581427) loss_w: 0.047728 (0.174786) loss_i: 2.617828 (2.033206) psnr: 28.660446 (inf) bit_acc_avg: 0.994792 (0.933054) word_acc_avg: 0.750000 (0.548780) lr: 0.000477 (0.000359) time: 0.629592 data: 0.000160 max mem: 12793
Train [ 50/100] eta: 0:00:31 iteration: 40.000000 (25.000000) loss: 0.580158 (0.581512) loss_w: 0.035613 (0.150214) loss_i: 2.617828 (2.156490) psnr: 28.698269 (inf) bit_acc_avg: 0.994792 (0.944547) word_acc_avg: 0.750000 (0.607843) lr: 0.000420 (0.000364) time: 0.630018 data: 0.000142 max mem: 12793
Train [ 60/100] eta: 0:00:25 iteration: 50.000000 (30.000000) loss: 0.573796 (0.580115) loss_w: 0.033049 (0.131261) loss_i: 2.750878 (2.244271) psnr: 28.698269 (inf) bit_acc_avg: 1.000000 (0.953296) word_acc_avg: 1.000000 (0.668033) lr: 0.000337 (0.000352) time: 0.629921 data: 0.000136 max mem: 12793
Train [ 70/100] eta: 0:00:18 iteration: 60.000000 (35.000000) loss: 0.540854 (0.571989) loss_w: 0.028372 (0.118225) loss_i: 2.535046 (2.268818) psnr: 28.923550 (inf) bit_acc_avg: 1.000000 (0.959727) word_acc_avg: 1.000000 (0.707746) lr: 0.000241 (0.000331) time: 0.630056 data: 0.000135 max mem: 12793
Train [ 80/100] eta: 0:00:12 iteration: 70.000000 (40.000000) loss: 0.499992 (0.561918) loss_w: 0.027402 (0.107369) loss_i: 2.318766 (2.272747) psnr: 29.239080 (inf) bit_acc_avg: 1.000000 (0.964699) word_acc_avg: 1.000000 (0.743827) lr: 0.000146 (0.000303) time: 0.630138 data: 0.000143 max mem: 12793
Train [ 90/100] eta: 0:00:06 iteration: 80.000000 (45.000000) loss: 0.465462 (0.549673) loss_w: 0.029787 (0.098901) loss_i: 2.237760 (2.253861) psnr: 29.139305 (inf) bit_acc_avg: 1.000000 (0.968464) word_acc_avg: 1.000000 (0.766484) lr: 0.000067 (0.000274) time: 0.630950 data: 0.000147 max mem: 12793
Train [ 99/100] eta: 0:00:00 iteration: 89.000000 (49.500000) loss: 0.451421 (0.540687) loss_w: 0.029787 (0.092752) loss_i: 2.071455 (2.239677) psnr: 29.950317 (inf) bit_acc_avg: 1.000000 (0.971042) word_acc_avg: 1.000000 (0.782500) lr: 0.000020 (0.000250) time: 0.630887 data: 0.000150 max mem: 12793
Train Total time: 0:01:03 (0.626767 s / it)
Averaged train stats: iteration: 89.000000 (49.500000) loss: 0.451421 (0.540687) loss_w: 0.029787 (0.092752) loss_i: 2.071455 (2.239677) psnr: 29.950317 (inf) bit_acc_avg: 1.000000 (0.971042) word_acc_avg: 1.000000 (0.782500) lr: 0.000020 (0.000250)
Eval [0/7] eta: 0:00:20 iteration: 0.000000 (0.000000) psnr: 28.852217 (28.852217) bit_acc_none: 0.998698 (0.998698) word_acc_none: 0.937500 (0.937500) bit_acc_crop_01: 0.959635 (0.959635) word_acc_crop_01: 0.250000 (0.250000) bit_acc_crop_05: 0.993490 (0.993490) word_acc_crop_05: 0.812500 (0.812500) bit_acc_rot_25: 0.707031 (0.707031) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.480469 (0.480469) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.734375 (0.734375) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.993490 (0.993490) word_acc_resize_07: 0.750000 (0.750000) bit_acc_brightness_1p5: 0.990885 (0.990885) word_acc_brightness_1p5: 0.750000 (0.750000) bit_acc_brightness_2: 0.981771 (0.981771) word_acc_brightness_2: 0.437500 (0.437500) bit_acc_jpeg_80: 0.919271 (0.919271) word_acc_jpeg_80: 0.000000 (0.000000) bit_acc_jpeg_50: 0.869792 (0.869792) word_acc_jpeg_50: 0.000000 (0.000000) time: 2.992712 data: 0.428055 max mem: 12793
Eval [6/7] eta: 0:00:01 iteration: 3.000000 (3.000000) psnr: 29.593250 (29.743545) bit_acc_none: 0.998698 (0.996838) word_acc_none: 0.937500 (0.901786) bit_acc_crop_01: 0.937500 (0.943452) word_acc_crop_01: 0.250000 (0.223214) bit_acc_crop_05: 0.993490 (0.992932) word_acc_crop_05: 0.812500 (0.812500) bit_acc_rot_25: 0.688802 (0.692708) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.460938 (0.465030) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.750000 (0.747768) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.990885 (0.988839) word_acc_resize_07: 0.750000 (0.696429) bit_acc_brightness_1p5: 0.994792 (0.992560) word_acc_brightness_1p5: 0.875000 (0.848214) bit_acc_brightness_2: 0.985677 (0.980841) word_acc_brightness_2: 0.562500 (0.580357) bit_acc_jpeg_80: 0.915365 (0.913132) word_acc_jpeg_80: 0.000000 (0.000000) bit_acc_jpeg_50: 0.861979 (0.857515) word_acc_jpeg_50: 0.000000 (0.000000) time: 1.633375 data: 0.061247 max mem: 12793
Eval Total time: 0:00:11 (1.437312 s / it)
Averaged eval stats: iteration: 3.000000 (3.000000) psnr: 29.593250 (29.743545) bit_acc_none: 0.998698 (0.996838) word_acc_none: 0.937500 (0.901786) bit_acc_crop_01: 0.937500 (0.943452) word_acc_crop_01: 0.250000 (0.223214) bit_acc_crop_05: 0.993490 (0.992932) word_acc_crop_05: 0.812500 (0.812500) bit_acc_rot_25: 0.688802 (0.692708) word_acc_rot_25: 0.000000 (0.000000) bit_acc_rot_90: 0.460938 (0.465030) word_acc_rot_90: 0.000000 (0.000000) bit_acc_resize_03: 0.750000 (0.747768) word_acc_resize_03: 0.000000 (0.000000) bit_acc_resize_07: 0.990885 (0.988839) word_acc_resize_07: 0.750000 (0.696429) bit_acc_brightness_1p5: 0.994792 (0.992560) word_acc_brightness_1p5: 0.875000 (0.848214) bit_acc_brightness_2: 0.985677 (0.980841) word_acc_brightness_2: 0.562500 (0.580357) bit_acc_jpeg_80: 0.915365 (0.913132) word_acc_jpeg_80: 0.000000 (0.000000) bit_acc_jpeg_50: 0.861979 (0.857515) word_acc_jpeg_50: 0.000000 (0.000000)
CLUTIL_JOB_FINISHED
CLUTIL_TIME 924