aoliverg's picture
Upload 4 files
95ead5e verified
ARG=i
ARG=r
ARG=d
ARG=v
ARG=o
ARG=p
INITIAL PASS
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
....
expected target length = source length * 0.969994
ITERATION 1
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
....
log_e likelihood: -4.13444e+08
log_2 likelihood: -5.96474e+08
cross entropy: 29.8974
perplexity: 1e+09
posterior p0: 0.08
posterior al-feat: -0.165564
size counts: 5481
ITERATION 2
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
....
log_e likelihood: -1.43112e+08
log_2 likelihood: -2.06468e+08
cross entropy: 10.3489
perplexity: 1304.13
posterior p0: 0.098097
posterior al-feat: -0.130112
size counts: 5481
1 model al-feat: -0.183369 (tension=4)
2 model al-feat: -0.157963 (tension=5.06514)
3 model al-feat: -0.146872 (tension=5.62218)
4 model al-feat: -0.14082 (tension=5.95738)
5 model al-feat: -0.137176 (tension=6.17154)
6 model al-feat: -0.134862 (tension=6.31283)
7 model al-feat: -0.133344 (tension=6.40784)
8 model al-feat: -0.132329 (tension=6.4725)
final tension: 6.51685
ITERATION 3
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
....
log_e likelihood: -1.19844e+08
log_2 likelihood: -1.72898e+08
cross entropy: 8.66623
perplexity: 406.252
posterior p0: 0.0847109
posterior al-feat: -0.0956117
size counts: 5481
1 model al-feat: -0.13164 (tension=6.51685)
2 model al-feat: -0.121297 (tension=7.23742)
3 model al-feat: -0.114793 (tension=7.75114)
4 model al-feat: -0.110344 (tension=8.13476)
5 model al-feat: -0.107142 (tension=8.42941)
6 model al-feat: -0.104755 (tension=8.66001)
7 model al-feat: -0.102933 (tension=8.84288)
8 model al-feat: -0.101517 (tension=8.98931)
final tension: 9.10741
ITERATION 4
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
....
log_e likelihood: -1.14963e+08
log_2 likelihood: -1.65857e+08
cross entropy: 8.31332
perplexity: 318.095
posterior p0: 0.0846553
posterior al-feat: -0.0772568
size counts: 5481
1 model al-feat: -0.100402 (tension=9.10741)
2 model al-feat: -0.0962466 (tension=9.57031)
3 model al-feat: -0.0930761 (tension=9.9501)
4 model al-feat: -0.0905846 (tension=10.2665)
5 model al-feat: -0.0885832 (tension=10.533)
6 model al-feat: -0.0869484 (tension=10.7596)
7 model al-feat: -0.0855951 (tension=10.9534)
8 model al-feat: -0.0844631 (tension=11.1202)
final tension: 11.2643
ITERATION 5 (FINAL)
.................................................. [50000]
.................................................. [100000]
.................................................. [150000]
.................................................. [200000]
.................................................. [250000]
.................................................. [300000]
.................................................. [350000]
.................................................. [400000]
.................................................. [450000]
.................................................. [500000]
.................................................. [550000]
.................................................. [600000]
.................................................. [650000]
.................................................. [700000]
....
log_e likelihood: -1.13112e+08
log_2 likelihood: -1.63186e+08
cross entropy: 8.17945
perplexity: 289.908
posterior p0: 0
posterior al-feat: 0
size counts: 5481
conditional probabilities: ast-es.params