15:13:38 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 15:13:38 evaluator INFO:duckietown-challenges:evaluation: Preparing here.. 15:13:38 evaluator INFO:duckietown-challenges:evaluation: Solution parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 15:13:38 evaluator DEBUG:duckietown-challenges:evaluation: gym started with pid = 90 15:13:38 evaluator INFO:duckietown-challenges:evaluation: Waiting for Gym to activate... 15:13:38 evaluator INFO:duckietown-challenges:evaluation: Preparation done. 15:13:38 evaluator DEBUG:duckietown-challenges:Written to: /challenge-description/description.yaml 15:13:38 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (0 secs passed, will wait 600 secs more) 15:13:38 evaluator launch.sh > Starting xvfb 15:13:38 evaluator launch.sh > Started xvfb with PID 92 15:13:38 evaluator launch.sh > Now running gym_simulation_launcher.py 15:13:39 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 15:13:39 evaluator INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 15:13:39 evaluator INFO:gym-duckietown:gym-duckietown 2018.10.1 15:13:39 evaluator 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_obstacles-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-straight_road-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-zigzag_dists-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_dyn_duckiebots-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_pedestrians-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-test_loop_obstacles-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-udem1-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_empty-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-4way-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop_cw-v0 15:13:39 evaluator WARNING:rosout:Failed to load Python extension for LZ4 support. LZ4 compression will not be available. 15:13:39 evaluator launcher|gym_simulation_launcher.py:48 - main | launcher parameters: 15:13:39 evaluator 15:13:39 evaluator { 15:13:39 evaluator "challenge": "LF", 15:13:39 evaluator "episodes": 5, 15:13:39 evaluator "steps_per_episode": 500, 15:13:39 evaluator "environment-constructor": "Simulator", 15:13:39 evaluator "include_map": true, 15:13:39 evaluator "environment-parameters": { 15:13:39 evaluator "seed": 123, 15:13:39 evaluator "map_name": "loop_empty", 15:13:39 evaluator "max_steps": 500001, 15:13:39 evaluator "domain_rand": 0, 15:13:39 evaluator "camera_width": 640, 15:13:39 evaluator "camera_height": 480, 15:13:39 evaluator "accept_start_angle_deg": 4, 15:13:39 evaluator "full_transparency": true, 15:13:39 evaluator "distortion": true 15:13:39 evaluator }, 15:13:39 evaluator "agent-info": { 15:13:39 evaluator "challenge": "LF" 15:13:39 evaluator } 15:13:39 evaluator } 15:13:39 evaluator launcher|gym_simulation_launcher.py:59 - main | using gym-duckietown version 2018.10.1 15:13:39 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 15:13:39 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 15:13:39 evaluator gym-duckietown| simulator.py:490 - _load_map | loading map file "/workspace/gym-duckietown/gym_duckietown/maps/loop_empty.yaml" 15:13:39 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.obj" 15:13:39 evaluator gym-duckietown| objmesh.py:238 - _load_mtl | loading materials from "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.mtl" 15:13:40 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckie.obj" 15:13:40 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/duckie.png" 15:13:40 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/cone.obj" 15:13:40 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/cone.png" 15:13:40 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/floor_1.png" 15:13:40 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_left_1.png" 15:13:40 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/straight_1.png" 15:13:41 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_right_1.png" 15:13:41 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [4.05833625 0. 2.17835003] 1.62929007381 15:13:44 evaluator launcher|gym_simulation_launcher.py:74 - main | Logging gym state to: /tmp/tmpp1QvJa/episodes 15:13:44 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [2.75442323 0. 3.0079666 ] 4.83604950287 15:13:44 evaluator launcher|gym_simulation_launcher.py:89 - main | Simulator listening to incoming connections... 15:13:44 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep000 15:13:44 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:13:44 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:13:44 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.57449761 0. 1.00806868] 0.0328325810557 15:13:44 evaluator launcher|gym_simulation_launcher.py:237 - run_episode | received ping: {u'topic': 1, u'ip': u'172.25.0.2', u'id': u'90960', u'msg': u'0'} 15:13:44 evaluator launcher|gym_simulation_launcher.py:240 - run_episode | received 2, resetting: {u'topic': 2, u'ip': u'172.25.0.2', u'id': u'90960', u'msg': u'0'} 15:13:44 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.9473256 0. 2.19364627] 4.70207132071 15:13:48 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (10 secs passed, will wait 590 secs more) 15:13:49 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.708, done=False 15:13:50 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.642, done=False 15:13:51 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-1.294, done=False 15:13:52 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward15:13:38 solution INFO:gym-duckietown-agent:gym-duckietown-agent 2018.10.1 15:13:38 solution INFO:duckietown-challenges:duckietown-challenges 3.2.13 15:13:39 solution INFO:duckietown-challenges:solution:Parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 15:13:39 solution INFO:duckietown-challenges:solution:Starting. 15:13:39 solution INFO:duckietown-challenges:solution:Creating model. 15:13:39 solution INFO:duckietown-challenges:solution:Making environment 15:13:39 solution INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 15:13:39 solution INFO:duckietown-challenges:solution:Reset environment 15:13:42 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 15:13:46 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 15:14:10 solution Starting submission 15:14:10 solution (u'starting sub socket on', 8902) 15:14:10 solution [[-6949.509 -2805.532 -6481.555 -5825.258 -4227.846]] 15:14:10 solution [[-2453.123 -1216.897 -1967.076 -2517.024 -1611.423]] 15:14:10 solution [[-128.912 -264.756 -112.842 -221.229 -328.373]] 15:14:10 solution [[ -52.566 -199.035 -47.939 -58.576 -243.412]] 15:14:10 solution [[ -39.657 -177.266 -34.558 -40.564 -214.541]] 15:14:10 solution [[ -21.296 -148.706 -23.719 -29.284 -178.782]] 15:14:10 solution [[ -12.77 -140.059 -14.416 -23.283 -168.116]] 15:14:10 solution [[ -29.263 -178.303 -21.059 -31.845 -216.724]] 15:14:10 solution [[ -41.852 -226.187 -35.22 -47.783 -277.955]] 15:14:10 solution [[ -32.931 -231.552 -25.142 -38.474 -284.456]] 15:14:10 solution [[ -23.509 -230.119 -15.75 -21.03 -282.674]] 15:14:10 solution [[ -26.973 -230.187 -19.575 -26.622 -282.587]] 15:14:10 solution [[ -23.027 -218.155 -12.798 -24.832 -267.941]] 15:14:10 solution [[ -22.848 -219.279 -5.215 -15.014 -268.57 ]] 15:14:10 solution [[ -13.982 -197.377 -12.356 -21.817 -241.414]] 15:14:10 solution [[ -20.771 -185.725 -9.917 -28.021 -226.189]] 15:14:10 solution [[ -15.118 -177.24 -6.749 -18.326 -214.622]] 15:14:10 solution [[ -8.073 -160.669 -2.389 -15.295 -193.042]] 15:14:10 solution [[ -10.844 -141.221 4.286 -13.58 -168.165]] 15:14:10 solution [[ -4.314 -110.72 6.409 -8.656 -130.275]] 15:14:10 solution [[ 7.248 -84.083 7.34 6.95 -99.533]] 15:14:10 solution [[ 10.642 -80.879 0.62 7.085 -99.726]] 15:14:10 solution [[ 6.026 -90.687 -19.696 -12.822 -116.065]] 15:14:10 solution [[ 5.551 -81.843 5.358 5.247 -96.971]] 15:14:10 solution [[ -21.319 -134.551 -0.901 -12.867 -161.119]] 15:14:10 solution [[ -36.547 -198.976 -16.933 -31.485 -243.361]] 15:14:10 solution [[ -30.792 -167.719 -7.813 -19.124 -206.794]] 15:14:10 solution [[ -7.475 -101.097 -0.28 -4.269 -123.5 ]] 15:14:10 solution [[ 1.775 -60.126 2.731 1.969 -77.119]] 15:14:10 solution [[ 5.515 -61.687 -5.511 1.902 -82.951]] 15:14:10 solution [[ 2.10000e-02 -9.08070e+01 -3.24650e+01 -2.19980e+01 -1.22841e+02]] 15:14:10 solution [[ 4.248 -59.105 4.091 5.167 -76.952]] 15:14:10 solution [[ -11.353 -100.047 1.291 -1.827 -126.587]] 15:14:10 solution [[ 4.89 -99.163 5.4 5.77 -128.75 ]] 15:14:10 solution [[ 8.637 -73.287 4.075 7.787 -96.993]] 15:14:10 solution [[ 0.371 -68.351 -5.276 -0.464 -89.419]] 15:14:10 solution [[ -8.456 -122.234 -0.637 0.98 -158.877]] 15:14:10 solution [[ -12.258 -172.613 -6.877 -4.12 -226.931]] 15:14:10 solution [[ -18.495 -157.895 -13.301 -6.723 -205.16 ]] 15:14:10 solution [[ -21.225 -161.771 -15.032 -10.087 -208.606]] 15:14:10 solution [[ -14.679 -156.514 -20.476 -16.461 -198.737]] 15:14:10 solution [[ -24.022 -147.293 -18.649 -20.217 -181.496]] 15:14:10 solution [[ -32.504 -189.658 -21.673 -22.743 -239.467]] 15:14:10 solution [[ -24.111 -138.459 -22.489 -23.23 -170.237]] 15:14:10 solution [[ -25.663 -171.861 -49.489 -38.065 -210.349]] 15:14:10 solution [[ -40.121 -239.172 -96.154 -78.774 -289.484]] 15:14:10 solution [[ -34.196 -212.818 -70=-1.033, done=False 15:13:53 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.738, done=False 15:13:54 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.616, done=False 15:13:56 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.755, done=False 15:13:57 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.157, done=False 15:13:58 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.344, done=False 15:13:58 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (20 secs passed, will wait 580 secs more) 15:13:59 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.729, done=False 15:14:00 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.797, done=False 15:14:01 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.849, done=False 15:14:02 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-1.172, done=False 15:14:03 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-1.757, done=False 15:14:04 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-2.004, done=False 15:14:05 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-1.637, done=False 15:14:06 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-1.809, done=False 15:14:07 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-1.409, done=False 15:14:08 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-1.084, done=False 15:14:08 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (30 secs passed, will wait 570 secs more) 15:14:09 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.784, done=False 15:14:10 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:14:10 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep000 15:14:10 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:14:10 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep001 15:14:10 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:14:10 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:14:10 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.94220351 0. 1.23114947] 4.68721314392 15:14:11 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.596, done=False 15:14:13 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.696, done=False 15:14:14 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.779, done=False 15:14:15 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.685, done=False 15:14:16 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.687, done=False 15:14:17 evalua.892 -52.006 -258.916]] 15:14:10 solution [[ -26.914 -189.166 -51.343 -38.692 -232.715]] 15:14:10 solution [[ -25.515 -179.101 -35.308 -29.577 -224.027]] 15:14:10 solution [[ -21.549 -170.726 -32.009 -25.119 -216.505]] 15:14:10 solution [[ -18.878 -152.091 -25.225 -20.182 -195.601]] 15:14:10 solution [[ -19.816 -135.931 -22.185 -20.236 -173.397]] 15:14:10 solution [[ -22.417 -128.718 -25.52 -23.199 -163.326]] 15:14:10 solution [[ -29.503 -132.521 -34.253 -30.659 -166.25 ]] 15:14:10 solution [[ -29.244 -140.111 -24.848 -23.009 -177.33 ]] 15:14:10 solution [[ -21.063 -147.46 -22.94 -17.367 -188.366]] 15:14:10 solution [[ -17.847 -112.251 -25.728 -21.034 -141.626]] 15:14:10 solution [[ -21.889 -136.363 -51.955 -39.726 -166.226]] 15:14:10 solution [[ -13.138 -144.825 -39.254 -26.221 -179.669]] 15:14:10 solution [[ -7.411 -157.719 -24.608 -15.448 -192.292]] 15:14:10 solution [[ -9.82 -158.197 -6.671 -6.85 -195.637]] 15:14:10 solution [[ -27.009 -171.897 -8.892 -17.039 -210.328]] 15:14:10 solution [[ 1.586 -138.025 2.285 3.143 -167.83 ]] 15:14:10 solution [[ -2.187 -171.122 -37.034 -29.252 -206.629]] 15:14:10 solution [[ 1.072 -175.298 -18.842 -17.041 -210.565]] 15:14:10 solution [[ -1.639 -156.925 2.803 -0.447 -181.2 ]] 15:14:10 solution [[ -10.72 -158.415 -5.277 -9.877 -185.035]] 15:14:10 solution [[ 1.426 -143.167 6.193 0.877 -166.429]] 15:14:10 solution [[ 9.447 -147.102 10.952 10.167 -169.491]] 15:14:10 solution [[ 7.858 -160.541 4.213 5.53 -186.175]] 15:14:10 solution [[ 5.884 -166.82 -3.45 -1.299 -199.014]] 15:14:10 solution [[ -5.407 -148.419 -4.196 -18.714 -171.595]] 15:14:10 solution [[ -1.822 -162.395 4.512 -3.579 -191.139]] 15:14:10 solution [[ -8.712 -164.017 -9.591 -21.222 -191.792]] 15:14:10 solution [[ -11.251 -158.645 -6.245 -26.928 -186.416]] 15:14:10 solution [[ -10.493 -180.267 -1.746 -13.58 -214.884]] 15:14:10 solution [[ -8.63 -175.705 -3.352 -18.605 -207.692]] 15:14:10 solution [[ -3.659 -146.611 12.713 -5.362 -170.686]] 15:14:10 solution [[ 5.399 -123.413 15.143 4.272 -141.841]] 15:14:10 solution [[ 14.569 -91.781 14.174 14.373 -106.612]] 15:14:10 solution [[ 12.332 -95.661 4.919 10.092 -114.781]] 15:14:10 solution [[ 6.829 -107.243 13.462 6.407 -123.629]] 15:14:33 solution [[ -18.767 -176.805 7.952 -5.45 -210.227]] 15:14:33 solution [[ -4.108 -131.337 10.34 1.932 -155.946]] 15:14:33 solution [[ 7.563 -70.643 -7.031 2.659 -94.252]] 15:14:33 solution [[ -4.298 -119.607 -28.051 -13.047 -157.963]] 15:14:33 solution [[ -1.73 -108.592 -10.853 -2.981 -140.221]] 15:14:33 solution [[ -0.316 -111.691 2.981 3.47 -143.338]] 15:14:33 solution [[ -25.202 -183.298 -3.891 -3.023 -232.647]] 15:14:33 solution [[ -16.931 -165.636 -0.602 -2.845 -214.262]] 15:14:33 solution [[ -3.593 -128.229 2.949 4.739 -165.24 ]] 15:14:33 solution [[ 6.344 -93.633 -0.124 4.885 -122.575]] 15:14:33 solution [[ 8.541 -100.593 -8.016 3.333 -133.616]] 15:14:33 solution [[ 1.265 -109.059 1.908 3.542 -140.307]] 15:14:33 solution [[ -17.459 -175.888 -9.264 -5.584 -224.431]] 15:14:33 solution [[ -3.368 -120.122 -0.798 -0.163 -153.196]] 15:14:33 solution [[ -2.443 -111.961 1.139 1.304 -143.244]] 15:14:33 solution [[ 0.341 -95.562 0.679 2.353 -122.588]] 15:14:33 solution [[ 1.365 -96.299 -18.085 -5.677 -125.952]] 15:14:33 solution [[ -11.098 -129.318 -40.695 -25.256 -169.179]] 15:14:33 solution [[ -3.993 -98.879 -3.001 -1.311 -125.869]] 15:14:33 solution [[ -10.827 -128.174 -6.119 -4.566 -162.953]] 15:14:33 solution [[ -8.692 -136.372 -4.001 -0.954 -174.752]] 15:14:33 solution [[ -1.791 -115.935 -5.955 -0.66 -149.412]] 15:14:33 solution [[ -3.459 -130.019 -25.439 -9.49 -169.786]] 15:14:33 solution [[ -6.462 -162.121 -28.497 -12.132 -205.276]] 15:14:33 solution [[ -10.546 -167.216 -12.732 -6.487 -207.836]] 15:14:33 solution [[ -27.117 -195.792 -7.617 -13.631 tor launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.648, done=False 15:14:18 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.595, done=False 15:14:18 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (40 secs passed, will wait 560 secs more) 15:14:19 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.541, done=False 15:14:20 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.442, done=False 15:14:21 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.933, done=False 15:14:22 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.475, done=False 15:14:24 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.595, done=False 15:14:25 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.45, done=False 15:14:26 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=0.17, done=False 15:14:27 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.025, done=False 15:14:28 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.332, done=False 15:14:28 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (50 secs passed, will wait 550 secs more) 15:14:29 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.462, done=False 15:14:30 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.837, done=False 15:14:31 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-1.102, done=False 15:14:32 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-1.363, done=False 15:14:33 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:14:33 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep001 15:14:33 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:14:33 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep002 15:14:33 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:14:33 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:14:33 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [0.84497723 0. 1.12248482] 4.62469817798 15:14:34 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.106, done=False 15:14:36 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.254, done=False 15:14:37 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.416, done=False 15:14:38 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.466, done=False 15:14:38 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (60 secs passed, will wait 540 secs more) 15:14:39 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.537, done=False 15:14:41 evaluator l-238.232]] 15:14:33 solution [[ -20.739 -197.603 -2.695 -5.282 -239.256]] 15:14:33 solution [[ -10.373 -203.415 -27.194 -20.302 -246.026]] 15:14:33 solution [[ -42.012 -258.449 -109.053 -113.037 -307.385]] 15:14:33 solution [[ -53.1 -226.755 -36.117 -68.23 -269.454]] 15:14:33 solution [[ -58.915 -213.45 -14.368 -50.322 -251.963]] 15:14:33 solution [[ -8.187 -210.946 -29.851 -18.975 -251.662]] 15:14:33 solution [[ -2.644 -216.903 -55.004 -34.764 -257.078]] 15:14:33 solution [[ -29.594 -192.298 -23.415 -26.89 -224.9 ]] 15:14:33 solution [[ -61.794 -200.03 -41.765 -55.675 -233.488]] 15:14:33 solution [[ -26.72 -187.375 -12.771 -19.596 -219.535]] 15:14:33 solution [[ -14.646 -192.887 -15.669 -16.161 -224.512]] 15:14:33 solution [[ -19.64 -197.73 -17.652 -29.662 -232.971]] 15:14:33 solution [[ -27.815 -194.904 -22.941 -43.189 -228.679]] 15:14:33 solution [[ -31.729 -218.052 -28.835 -48.259 -258.557]] 15:14:33 solution [[ -28.816 -218.497 -26.726 -46.186 -256.913]] 15:14:33 solution [[ -20.173 -193.927 -13.581 -31.971 -228.906]] 15:14:33 solution [[ -28.191 -199.224 -28.13 -41.192 -235.786]] 15:14:33 solution [[ -22.57 -185.254 -17.419 -35.015 -222.961]] 15:14:33 solution [[ -18.392 -190.271 -12.3 -18.344 -230.165]] 15:14:33 solution [[ -5.028 -175.432 -6.269 -0.747 -212.671]] 15:14:33 solution [[ 5.533 -148.028 -1.345 4.151 -180.521]] 15:14:33 solution [[ -3.273 -136.353 -3.291 -14.497 -165.263]] 15:14:33 solution [[ -26.543 -176.386 -17.193 -27.785 -210.837]] 15:14:33 solution [[ -67.163 -219.356 -47.646 -84.251 -269.908]] 15:14:33 solution [[ -55.816 -207.713 -29.715 -54.676 -255.96 ]] 15:14:33 solution [[ -37.889 -173.5 -24.062 -48.807 -211.838]] 15:14:33 solution [[ -19.519 -118.342 -3.098 -26.886 -143.413]] 15:14:33 solution [[ 3.491 -77.949 5.866 3.613 -93.219]] 15:14:33 solution [[ 6.437 -67.002 -1.522 3.621 -85.98 ]] 15:14:33 solution [[ 8.142 -72.751 -11.421 -2.651 -97.364]] 15:14:33 solution [[ 1.017 -64.06 0.842 0.661 -80.475]] 15:14:33 solution [[ -22.268 -132.336 -4.698 -8.947 -160.365]] 15:14:33 solution [[ -36.747 -203.617 -22.147 -33.636 -251.436]] 15:14:33 solution [[ -35.023 -168.984 -14.761 -18.226 -210.618]] 15:14:33 solution [[-1.23440e+01 -1.10648e+02 -9.30000e-02 -2.35900e+00 -1.40494e+02]] 15:14:33 solution [[ 11.441 -70.613 9.268 10.875 -93.607]] 15:14:33 solution [[ 6.741 -66.732 -0.576 5.244 -88.78 ]] 15:14:33 solution [[ 2.57 -102.882 6.614 7.088 -133.702]] 15:14:33 solution [[ 4.08 -159.06 8.441 -2.613 -211.967]] 15:14:33 solution [[ 14.041 -158.661 19.185 4.547 -216.067]] 15:14:33 solution [[ -1.969 -111.656 1.622 3.578 -145.587]] 15:14:33 solution [[ 2.118 -86.09 -4.235 0.594 -112.434]] 15:14:33 solution [[ -4.925 -120.535 -17.631 -7.835 -156.284]] 15:14:33 solution [[ -3.768 -121.99 -5.134 -1.921 -157.953]] 15:14:33 solution [[ -11.257 -174.463 -12.793 -12.59 -229.694]] 15:14:33 solution [[ -12.264 -169.039 -9.261 -5.268 -218.645]] 15:14:33 solution [[ -10.542 -188.549 -17.854 -12.739 -248.76 ]] 15:14:33 solution [[ -37.863 -201.164 -34.727 -39.106 -261.939]] 15:14:33 solution [[ -30.302 -197.054 -44.819 -41.764 -261.233]] 15:14:33 solution [[ -32.999 -195.109 -28.605 -30.53 -251.827]] 15:14:33 solution [[ -15.997 -186.783 -26.973 -15.506 -244.764]] 15:14:33 solution [[ -15.353 -157.563 -22.944 -15.908 -199.831]] 15:14:33 solution [[ -19.563 -159.644 -34.46 -24.622 -203.384]] 15:14:33 solution [[ -20.872 -157.744 -36.903 -26.925 -202.606]] 15:14:33 solution [[ -11.815 -134.288 -20.03 -13.945 -173.388]] 15:14:33 solution [[ -15.376 -140.217 -23.473 -17.507 -179.713]] 15:14:33 solution [[ -16.7 -127.812 -22.809 -18.505 -162.806]] 15:14:33 solution [[ -18.207 -130.469 -26.179 -20.079 -166.46 ]] 15:14:57 solution [[ -16.165 -134.512 -24.47 -16.521 -172.504]] 15:14:57 solution [[ -16.792 -158.281 -18.953 -12.918 -201.69 ]] 15:14:57 solution [[ -29.005 -171.693 -77.155 -68.494 -222.19 ]] 15:14:57 solution [[ -40.183 -191.332 -78.932 -77.32 -246.87 ]] 15:14:57 solution [[ -14.398 -146.766 -59.117 -55.082 -183.293]] 15:14:57 solution [[ 6.592 -90.873 -13.136 -7.308 -112.818]] 15:14:57 solution [[ 4.039 -76.771 8.68 5.904 -90.109]] 15:14:57 solution [[ -9.461 -127.135 10.177 1.822 -149.691]] 15:14:57 solution [[ 4.075 -82.221 8.155 6.253 -100.706]] 15:14:57 solution [[ 10.664 -66.832 -0.162 7.009 -87.573]] 15:14:57 solution [[ 6.715 -101.243 -27.963 -16.129 -130.971]] 15:14:57 solution [[ 7.67 -67.08 7.455 7.906 -81.385]] 15:14:57 solution [[-3.77900e+00 -1.02923e+02 4.42600e+00 5.50000e-02 -1.22603e+02]] 15:14:57 solution [[ 4.714 -69.874 12.188 8.003 -85.764]] 15:14:57 solution [[ 6.152 -55.009 -3.976 1.87 -73.308]] 15:14:57 solution [[ -1.694 -99.537 -25.948 -12.616 -127.983]] 15:14:57 solution [[ -1.472 -62.58 0.2 -0.138 -79.359]] 15:14:57 solution [[ -0.748 -82.921 5.689 2.584 -101.343]] 15:14:57 solution [[ 2.631 -77.265 -7.065 -0.539 -100.888]] 15:14:57 solution [[ 0.983 -97.491 -20.223 -7.425 -127.245]] 15:14:57 solution [[ 2.7000e-02 -7.6876e+01 -1.4410e+00 7.9200e-01 -9.8386e+01]] 15:14:57 solution [[ 0.234 -98.321 5.919 3.646 -120.689]] 15:14:57 solution [[ 2.72 -89.093 5.859 5.747 -113.983]] 15:14:57 solution [[ 5.756 -82.046 -9.962 0.683 -109.212]] 15:14:57 solution [[ 0.937 -119.388 -25.743 -11.952 -154.204]] 15:14:57 solution [[ -0.984 -79.192 -4.515 -0.731 -102.036]] 15:14:57 solution [[ -2.007 -86.692 3.785 1.822 -108.893]] 15:14:57 solution [[ -0.744 -88.921 2.485 1.975 -113.614]] 15:14:57 solution [[ -2.786 -108.101 -27.083 -12.125 -142.418]] 15:14:57 solution [[ -6.697 -145.317 -39.382 -24.62 -187.096]] 15:14:57 solution [[ -2.14 -93.76 -12.163 -4.9 -120.261]] 15:14:57 solution [[ -5.562 -105.882 0.411 -1.305 -131.29 ]] 15:14:57 solution [[ -15.655 -152.544 -3.207 -5.539 -189.926]] 15:14:57 solution [[ -5.605 -93.481 0.602 -2.101 -118.163]] 15:14:57 solution [[ -4.144 -116.026 -28.649 -13.697 -151.653]] 15:14:57 solution [[ -7.378 -162.004 -38.044 -21.82 -204.298]] 15:14:57 solution [[ -2.655 -91.398 -8.996 -4.078 -116.411]] 15:14:57 solution [[ -6.723 -108.309 4.299 -0.857 -133.406]] 15:14:57 solution [[ -28.157 -188.538 -5.743 -8.545 -235.283]] 15:14:57 solution [[ -7.911 -105.103 0.717 -3.573 -132.622]] 15:14:57 solution [[ 1.603 -88.945 -13.276 -3.847 -116.897]] 15:14:57 solution [[ -4.85 -146.039 -29.377 -14.755 -185.696]] 15:14:57 solution [[ -11.278 -114.457 -25.188 -16.792 -144.921]] 15:14:57 solution [[ -11.247 -105.513 -2.442 -6.507 -131.469]] 15:14:57 solution [[ -23.155 -172.898 -5.268 -8.801 -214.872]] 15:14:57 solution [[ -5.31 -121.869 -0.382 -2.587 -155.264]] 15:14:57 solution [[-2.80000e-02 -1.04682e+02 -2.23740e+01 -9.58600e+00 -1.36070e+02]] 15:14:57 solution [[ -7.231 -148.676 -36.726 -19.57 -190.369]] 15:14:57 solution [[ -5.271 -102.433 -10.163 -6.311 -130.956]] 15:14:57 solution [[ -5.833 -115.016 -0.397 -1.97 -144.803]] 15:14:57 solution [[ -22.495 -175.683 -4.064 -6.478 -217.412]] 15:14:57 solution [[ -6.65 -110.279 0.52 -2.134 -138.921]] 15:14:57 solution [[ -0.443 -113.008 -17.793 -5.977 -148.204]] 15:14:57 solution [[ -6.38 -169.735 -31.946 -16.906 -214.163]] 15:14:57 solution [[ -4.202 -110.5 -10.267 -4.768 -141.373]] 15:14:57 solution [[ -8.274 -112.556 0.175 -3.129 -141.043]] 15:14:57 solution [[ -26.565 -181.774 -6.57 -8.985 -227.961]] 15:14:57 solution [[ -1.22 -119.086 4.962 2.788 -152.196]] 15:14:57 solution [[ -1.166 -111.577 -19.951 -8.048 -145.06 ]] 15:14:57 solution [[ -6.312 -161.127 -34.03 -17.701 -201.358]] 15:14:57 solution [[ -11.129 -134.993 -14.772 -9.865 -171.809]] 15:14:57 solution [[ -7.808 -125.975 -0.715 -2.997 -159.35 ]] 15:14:57 solution [[ -4.005 -113.995 -1.495 -1.064 -145.509]] 15:14:57 solution [[ -9.971 -142.379 -41.337 -23.017 -18auncher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.587, done=False 15:14:42 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.633, done=False 15:14:43 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.674, done=False 15:14:44 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.659, done=False 15:14:45 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.68, done=False 15:14:46 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.721, done=False 15:14:47 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.706, done=False 15:14:48 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.727, done=False 15:14:49 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (70 secs passed, will wait 530 secs more) 15:14:49 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.768, done=False 15:14:50 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.757, done=False 15:14:51 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.698, done=False 15:14:52 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.695, done=False 15:14:53 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.699, done=False 15:14:55 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.638, done=False 15:14:56 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.689, done=False 15:14:57 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:14:57 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep002 15:14:57 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:14:57 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep003 15:14:57 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:14:57 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:14:57 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.00329777 0. 0.86708317] 0.0349480490083 15:14:59 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (80 secs passed, will wait 520 secs more) 15:14:59 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-1.308, done=False 15:15:00 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-1.155, done=False 15:15:01 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-1.018, done=False 15:15:02 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.89, done=False 15:15:03 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.77, done=False 15:15:04 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.683, done=False 15:15:05 evaluator launcher|gym_simulation_launcher.py:231 1.901]] 15:14:57 solution [[ -10.03 -169.821 -37.185 -21.293 -210.196]] 15:14:57 solution [[ -13.288 -112.421 -16.819 -12.789 -142.534]] 15:14:57 solution [[ -17.098 -118.826 -0.327 -4.437 -149.887]] 15:14:57 solution [[ -12.781 -102.929 -7.781 -9.148 -129.505]] 15:14:57 solution [[ -19.174 -179.117 -54.679 -39.001 -222.947]] 15:14:57 solution [[ -23.41 -223.424 -78.163 -63.967 -278.199]] 15:14:57 solution [[ -20.574 -152.699 -46.94 -38.893 -189.487]] 15:14:57 solution [[ -38.591 -143.183 -16.657 -20.816 -174.227]] 15:14:57 solution [[ -42.886 -193.176 -17.981 -18.722 -244.856]] 15:14:57 solution [[ -16.001 -147.573 -14.71 -12.912 -185.533]] 15:14:57 solution [[ -16.953 -188.864 -54.199 -37.691 -232.766]] 15:14:57 solution [[ -15.205 -227.004 -56.134 -40.433 -275.336]] 15:14:57 solution [[ -23.144 -188.867 -39.881 -33.65 -226.178]] 15:14:57 solution [[ -51.332 -195.274 -17.537 -47.735 -231.66 ]] 15:14:57 solution [[ -73.741 -254.251 -64.557 -95.636 -316.341]] 15:14:57 solution [[ -33.157 -200.732 -35.779 -35.301 -241.67 ]] 15:14:57 solution [[ -25.443 -208.323 -57.471 -43.523 -251.613]] 15:14:57 solution [[ -28.024 -191.277 -31.161 -33.766 -228.637]] 15:14:57 solution [[ -48.735 -218.586 -54.052 -64.87 -266.048]] 15:15:18 solution [[ -48.193 -239.605 -58. -62.354 -295.245]] 15:15:18 solution [[ -49.839 -248.612 -47.786 -48.23 -307.1 ]] 15:15:18 solution [[ -44.488 -192.329 -55.795 -52.25 -245.847]] 15:15:18 solution [[ -11.725 -202.31 -2.166 -19.317 -276.027]] 15:15:18 solution [[ -82.077 -267.337 -61.796 -173.614 -372.405]] 15:15:18 solution [[ 8.497 -201.872 13.476 -0.777 -277.348]] 15:15:18 solution [[ 8.811 -146.139 10.037 7.01 -194.965]] 15:15:18 solution [[ 3.915 -129.546 -19.824 -5.431 -170.711]] 15:15:18 solution [[ -9.223 -141.172 -40.92 -22.004 -183.454]] 15:15:18 solution [[ 1.021 -120.573 -15.42 -3.98 -158.055]] 15:15:18 solution [[ 1.572 -130.743 0.507 5.536 -170.804]] 15:15:18 solution [[ -1.53 -177.938 0.296 -3.229 -236.75 ]] 15:15:18 solution [[ -7.454 -158.424 -1.461 3.937 -205.394]] 15:15:18 solution [[ 9.30000e-02 -1.26071e+02 -1.58960e+01 -5.42000e+00 -1.65977e+02]] 15:15:18 solution [[ -11.349 -148.21 -33.273 -19.342 -190.21 ]] 15:15:18 solution [[ -15.445 -163.891 -10.506 -9.49 -205.824]] 15:15:18 solution [[ -26.4 -183.704 -8.24 -11.291 -231.968]] 15:15:18 solution [[ -21.578 -187.614 -7.364 -12.54 -234.463]] 15:15:18 solution [[ -8.625 -204.421 -37.655 -23.694 -247.493]] 15:15:18 solution [[ -34.004 -252.441 -76.737 -79.793 -305.46 ]] 15:15:18 solution [[ -16.669 -213.277 -48.345 -37.618 -256.959]] 15:15:18 solution [[ -43.107 -186.51 -15.582 -28.532 -225.649]] 15:15:18 solution [[ -60.09 -199.477 -35.017 -39.554 -247.003]] 15:15:18 solution [[ -39.935 -176.161 -15.672 -31.115 -214.74 ]] 15:15:18 solution [[ -11.145 -185.116 -11.383 -12.098 -221.363]] 15:15:18 solution [[ -23.026 -205.676 -22.069 -30.126 -244.741]] 15:15:18 solution [[ -47.336 -196.318 -25.485 -46.502 -235.338]] 15:15:18 solution [[ -41.474 -206.264 -23.536 -45.27 -247.667]] 15:15:18 solution [[ -39.086 -219.762 -30.386 -53.356 -264.32 ]] 15:15:18 solution [[ -42.757 -234.577 -46.478 -62.013 -285.712]] 15:15:18 solution [[ -48.198 -241.387 -56.102 -71.34 -294.195]] 15:15:18 solution [[ -61.11 -228.31 -38.488 -74.492 -273.554]] 15:15:18 solution [[ -67.439 -255.848 -41.575 -67.256 -307.175]] 15:15:18 solution [[ -65.556 -248.21 -49.216 -74.35 -298.215]] 15:15:18 solution [[ -76.542 -242.784 -61.376 -93.62 -291.603]] 15:15:18 solution [[ -75.162 -249.505 -62.519 -86.615 -298.38 ]] 15:15:18 solution [[ -80.801 -249.92 -60.804 -88.692 -299.314]] 15:15:18 solution [[ -55.37 -225.135 -17.267 -46.899 -265.736]] 15:15:18 solution [[ -25.394 -214.173 4.394 -14.933 -251.935]] 15:15:18 solution [[ -0.736 -184.694 5.093 -2.21 -220.579]] 15:15:18 solution [[ 2.876 -174.793 -19.255 -16.983 -214.611]] 15:15:18 solution [[ 1.252 -168.592 -29.067 - run_episode | step_count=168, reward=-0.489, done=False 15:15:06 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.898, done=False 15:15:07 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.529, done=False 15:15:08 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.552, done=False 15:15:09 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (90 secs passed, will wait 510 secs more) 15:15:09 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.567, done=False 15:15:10 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=0.329, done=False 15:15:11 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=0.105, done=False 15:15:12 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.146, done=False 15:15:13 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.27, done=False 15:15:14 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.341, done=False 15:15:15 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.459, done=False 15:15:16 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.556, done=False 15:15:17 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.61, done=False 15:15:18 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.565, done=False 15:15:19 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (100 secs passed, will wait 500 secs more) 15:15:19 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:15:19 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep003 15:15:19 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:15:19 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep004 15:15:19 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:15:19 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:15:19 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [1.72410152 0. 3.21929481] 0.0317184229532 15:15:20 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-2.27, done=False 15:15:21 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-2.32, done=False 15:15:21 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-2.339, done=False 15:15:22 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-2.19, done=False 15:15:23 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-2.042, done=False 15:15:24 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-1.579, done=False 15:15:25 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-1.43, done=False 15:15:26 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, rewa-24.953 -209.571]] 15:15:18 solution [[ -2.461 -167.955 4.826 -4.11 -199.228]] 15:15:18 solution [[ -39.55 -198.332 7.077 -22.967 -233.068]] 15:15:18 solution [[ -12.376 -168.399 12.517 -4.866 -199.827]] 15:15:18 solution [[ 17.285 -129.845 11.144 16.225 -153.473]] 15:15:18 solution [[ 10.658 -124.579 -6.57 1.059 -153.232]] 15:15:18 solution [[ 6.765 -131.306 12.303 10.417 -154.755]] 15:15:18 solution [[ -52.368 -181.557 4.974 -34.042 -216.911]] 15:15:18 solution [[ -1.075 -134.471 20.452 12.201 -157.845]] 15:15:18 solution [[ 13.019 -96.407 10.642 13.18 -116.951]] 15:15:18 solution [[ 9.525 -97.829 -11.696 -3.059 -126.148]] 15:15:18 solution [[ 3.76 -102.108 -19.986 -9.198 -135.254]] 15:15:18 solution [[ 7.931 -89.774 9.117 9.672 -110.28 ]] 15:15:18 solution [[ -25.546 -164.506 4.358 -5.447 -197.799]] 15:15:18 solution [[ -19.183 -161.995 8.288 3.428 -197.98 ]] 15:15:18 solution [[ 4.587 -87.241 7.514 7.408 -110.919]] 15:15:18 solution [[ 8.083 -78.459 -6.729 3.71 -105.049]] 15:15:18 solution [[ 2.264 -113.689 -23.519 -7.583 -149.046]] 15:15:18 solution [[ 3.526 -85.948 -2.914 3.358 -111.849]] 15:15:18 solution [[ -2.436 -113.653 4.189 2.968 -139.737]] 15:15:18 solution [[ -47.192 -196.214 -4.146 -21.847 -242.291]] 15:15:18 solution [[ 3.007 -114.54 9.677 7.267 -142.495]] 15:15:18 solution [[ 6.85300e+00 -8.01620e+01 -2.80000e-02 5.93800e+00 -1.05094e+02]] 15:15:18 solution [[ 3.893 -94.563 -13.139 -1.745 -125.642]] 15:15:18 solution [[ 0.718 -78.075 2.64 3.009 -98.981]] 15:15:18 solution [[ -10.177 -127.623 4.73 1.028 -156.276]] 15:15:18 solution [[ -3.824 -101.216 3.224 0.393 -127.617]] 15:15:18 solution [[ 4.189 -82.176 -2.094 3.345 -107.004]] 15:15:18 solution [[ 0.456 -95.374 -22.152 -7.716 -126.779]] 15:15:18 solution [[ -3.449 -77.405 -2.443 -1.725 -98.134]] 15:15:18 solution [[ -18.34 -130.747 -4.542 -6.075 -163.919]] 15:15:18 solution [[ -6.281 -98.474 3.144 0.756 -124.759]] 15:15:18 solution [[ 4.219 -83.582 -5.826 1.806 -109.496]] 15:15:18 solution [[ -2.697 -108.463 -27.239 -11.426 -143.038]] 15:15:18 solution [[ -2.627 -90.295 -5.357 -1.676 -115.589]] 15:15:18 solution [[ -7.39 -119.006 0.207 0.574 -151.955]] 15:15:18 solution [[ -0.476 -103.948 3.671 4.651 -133.821]] 15:15:18 solution [[ 3.24 -85.064 0.753 4.269 -109.973]] 15:15:18 solution [[ 4.413 -95.984 -10.851 0.81 -126.691]] 15:15:18 solution [[ -4.456 -141.173 -30.288 -12.147 -183.421]] 15:15:18 solution [[ -11.411 -142.619 -7.421 -5.114 -179.184]] 15:15:18 solution [[ -26.249 -178.936 -8.468 -9.167 -224.705]] 15:15:39 solution [[ -13.429 -166.126 -2.613 -3.672 -205.845]] 15:15:39 solution [[ -5.149 -167.179 -20.009 -9.509 -208.832]] 15:15:39 solution [[ -50.991 -233.206 -61.45 -54.975 -286.048]] 15:15:39 solution [[ -63.435 -256.117 -30.547 -73.383 -300.931]] 15:15:39 solution [[-120.867 -297.584 -73.91 -196.713 -343.367]] 15:15:39 solution [[ -87.21 -274.664 -39.145 -124.151 -321.716]] 15:15:39 solution [[ -51.828 -229.249 -55.513 -60.555 -280.039]] 15:15:39 solution [[ -64.821 -220.01 -76.619 -70.98 -277.839]] 15:15:39 solution [[ -47.717 -236.701 -56.509 -50.22 -291.938]] 15:15:39 solution [[ -87.69 -265.779 -38.919 -104.178 -307.754]] 15:15:39 solution [[-152.778 -305.533 -85.143 -249.095 -349.876]] 15:15:39 solution [[-122.434 -292.775 -69.346 -190.689 -337.947]] 15:15:39 solution [[ -89.389 -251.608 -83.981 -139.296 -302.297]] 15:15:39 solution [[ -95.814 -233.498 -95.633 -121.186 -290.742]] 15:15:39 solution [[-109.085 -225.05 -112.975 -131.448 -290.465]] 15:15:39 solution [[ -75.481 -210.678 -56.419 -68.464 -271.165]] 15:15:39 solution [[-111.817 -233.3 -112.511 -132.679 -302.118]] 15:15:39 solution [[ -69.636 -212.878 -51.731 -60.687 -274.104]] 15:15:39 solution [[-110.266 -234.417 -111.887 -126.354 -303.427]] 15:15:39 solution [[ -71.986 -215.298 -53.938 -66.65 -277.476]] 15:15:39 solution [[ -96.907 -233.594 -90.45 -106.395 -302.406]] 15:15:39 solution [[ -41.343 -194.268 -19.81 -24.073 -249.562]] 15:15:39 solution [[ -18.729 -156.122 -21.072 -17.894 -199.58 ]] 15:15:39 solution [[ -23.627 -153.365 -47.747 -35.451 -193.696]] 15:15:39 solution [[ -24.275 -192.244 -64.14 -45.336 -239.334]] 15:15:39 solution [[ -23.753 -153.686 -54.81 -39.747 -190.131]] 15:15:39 solution [[ -22.084 -134.55 -29.21 -25.915 -165.318]] 15:15:39 solution [[ -25.198 -161.571 -21.073 -22.338 -197.54 ]] 15:15:39 solution [[ -33.111 -192.018 -27.145 -27.989 -237.199]] 15:15:39 solution [[ -27.233 -164.826 -39.3 -33.088 -203.556]] 15:15:39 solution [[ -28.245 -177.259 -65.704 -47.914 -216.446]] 15:15:39 solution [[ -27.461 -164.718 -54.153 -41.021 -202.682]] 15:15:39 solution [[ -30.062 -175.155 -37.641 -35.309 -213.684]] 15:15:39 solution [[ -22.809 -179.747 -25.069 -22.71 -219.292]] 15:15:39 solution [[ -25.927 -187.863 -28.278 -25.623 -229.539]] 15:15:39 solution [[ -26.494 -187.199 -47.701 -37.833 -228.986]] 15:15:39 solution [[ -49.803 -290.99 -73.416 -69.852 -346.693]] 15:15:39 solution [[ -49.616 -281.868 -56.684 -64.215 -341.458]] 15:15:39 solution [[ -67.458 -293.255 -72.159 -81.21 -359.626]] 15:15:39 solution [[ -83.68 -276.275 -100.062 -113.319 -347.814]] 15:15:39 solution [[-103.699 -282.925 -154.536 -154.073 -365.217]] 15:15:39 solution [[-102.576 -248.533 -120.947 -137.882 -319.273]] 15:15:39 solution [[-111.235 -232.604 -124.803 -146.802 -293.826]] 15:15:39 solution [[ -75.104 -202.693 -103.636 -104.336 -252.034]] 15:15:39 solution [[ -41.598 -186.013 -84.81 -77.642 -228.05 ]] 15:15:39 solution [[ -18.231 -169.352 -59.881 -43.056 -203.65 ]] 15:15:39 solution [[ -9.251 -157.466 -41.731 -26.519 -190.227]] 15:15:39 solution [[ -14.004 -140.877 -41.185 -27.238 -171.503]] 15:15:39 solution [[ -24.543 -151.157 -16.906 -16.404 -186.369]] 15:15:39 solution [[ -36.176 -184.94 -15.179 -18.152 -227.929]] 15:15:39 solution [[ -19.533 -165.047 -6.659 -10.42 -198.877]] 15:15:39 solution [[ -2.784 -141.905 -5.678 -2.074 -171.011]] 15:15:39 solution [[ 2.00000e-02 -1.72362e+02 -1.67000e+01 -1.22190e+01 -2.04472e+02]] 15:15:39 solution [[ 0.542 -141.514 -5.884 -2.534 -164.901]] 15:15:39 solution [[ -7.363 -153.27 -4.43 -6.938 -178.095]] 15:15:39 solution [[ -21.232 -192.635 -7.341 -11.835 -228.702]] 15:15:39 solution [[ -13.592 -169.243 -7.56 -15.396 -201.377]] 15:15:39 solution [[ -17.648 -172.673 -8.496 -17.972 -205.359]] 15:15:39 solution [[ -16.652 -166.347 -2.507 -19.378 -195.109]] 15:15:39 solution [[ 3.522 -147.046 12.839 8.626 -168.113]] 15:15:39 solution [[ 20.849 -122.914 24.92 22.387 -138.383]] 15:15:39 solution [[ 24.146 -102.931 22.398 23.801 -116.935]] 15:15:39 solution [[ 24.354 -115.53 9.97 14.846 -135.541]] 15:15:39 solution [[ 16.108 -107.89 19.954 17.294 -122.78 ]] 15:15:39 solution [[ 7.781 -150.907 17.457 11.148 -174.413]] 15:15:39 solution [[ 16.717 -111.761 25.483 18.753 -125.833]] 15:15:39 solution [[ 18.383 -95.755 17.966 17.113 -107.571]] 15:15:39 solution [[ 16.904 -98.088 11.076 13.856 -112.676]] 15:15:39 solution [[ 7.543 -117.793 15.168 8.688 -133.726]] 15:15:39 solution [[ 4.90000e-02 -1.71306e+02 7.43900e+00 2.68400e+00 -2.01187e+02]] 15:15:39 solution [[ 1.664 -123.712 12.413 3.911 -142.857]] 15:15:39 solution [[ 4.746 -93.191 9.221 5.125 -108.828]] 15:15:39 solution [[ 7.652 -91.171 3.135 6.486 -112.142]] 15:15:39 solution [[ 8.19 -95.234 -8.529 -1.742 -121.74 ]] 15:15:39 solution [[-2.38900e+00 -9.46780e+01 -5.60000e-02 -1.45100e+00 -1.14959e+02]] 15:15:39 solution [[ -17.452 -137.657 -0.396 -8.591 -162.621]] 15:15:39 solution [[ -7.219 -92.535 -3.518 -5.666 -116.309]] 15:15:39 solution [[ 0.298 -80.939 -6.981 -1.646 -105.061]] 15:15:39 solution [[ -3.085 -121.575 -34.567 -24.352 -155.852]] 15:15:39 solution [[ -5.269 -88.103 -2.432 -2.989 -109.63rd=-1.334, done=False 15:15:27 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-1.386, done=False 15:15:29 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (110 secs passed, will wait 490 secs more) 15:15:29 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-1.576, done=False 15:15:30 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-1.795, done=False 15:15:31 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-1.63, done=False 15:15:32 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-1.082, done=False 15:15:33 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.735, done=False 15:15:34 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.295, done=False 15:15:35 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=0.206, done=False 15:15:36 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=0.186, done=False 15:15:37 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=0.024, done=False 15:15:38 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.141, done=False 15:15:38 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.268, done=False 15:15:39 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (120 secs passed, will wait 480 secs more) 15:15:39 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:15:39 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep004 15:15:39 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:15:39 evaluator launcher|gym_simulation_launcher.py:140 - main | Simulation done. 15:15:39 evaluator launcher|gym_simulation_launcher.py:152 - main | Clean exit. 15:15:39 evaluator launcher|gym_simulation_launcher.py:263 - <module> | success 15:15:39 evaluator starting pub socket on port 8902 15:15:40 evaluator launch.sh > gym_simulation_launcher terminated with return code 0 15:15:40 evaluator launch.sh > Killing xvfb... 15:15:40 evaluator launch.sh > Killed. 15:15:40 evaluator launch.sh > Graceful exit of launch.sh with return code 0 15:15:49 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (130 secs passed, will wait 470 secs more) 15:15:59 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (140 secs passed, will wait 460 secs more) 15:16:03 evaluator ERROR:duckietown-challenges:declare failed: 15:16:03 evaluator InvalidSubmission: 15:16:03 evaluator Traceback (most recent call last): 15:16:03 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator 15:16:03 evaluator raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION]) 15:16:03 evaluator InvalidSubmission: Invalid solution: 15:16:03 evaluator Traceback (most recent call last): 15:16:03 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution 15:16:03 evaluator raise InvalidSubmission(msg) 15:16:03 evaluator InvalidSubmission: Uncaught exception in solution: 15:16:03 evaluator Traceback (most recent call last): 15:16:03 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution 15:16:03 evaluator solution.run(cis) 15:16:03 evaluator File "solution.py", line 118, in run 15:16:03 evaluator solve(params, cis) 15:16:03 evaluator File "solution.py", line 83, in solve 15:16:03 evaluator observation, reward, done, info = env.step(action) 15:16:03 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step 15:16:03 evaluator return self.env.step(action) 15:16:03 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step 15:16:03 evaluator observation, reward, done, info = self.env.step(action) 15:16:03 evaluator File "/workspace/wrappers.py", line 89, in step 15:16:03 evaluator ob, reward, done, info = self.env.step(action) 15:16:03 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step 15:16:03 evaluator observation, reward, done, info = self.env.step(action) 15:16:03 evaluator File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step 15:16:03 evaluator obs, rew, done, misc = self.sim.step(action, with_observation=True) 15:16:03 evaluator File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step 15:16:03 evaluator return self._failsafe_observe(msg) 15:16:03 evaluator File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe 15:16:03 evaluator raise Exception(msg) 15:16:03 evaluator Exception: Giving up to connect to the gym duckietown server at host: evaluator 15:16:03 evaluator 15:16:03 evaluator 15:16:03 evaluator 15:16:03 evaluator DEBUG:duckietown-challenges:Written to: /challenge-results/challenge_results.yaml