13:26:23 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 13:26:23 evaluator INFO:duckietown-challenges:evaluation: Preparing here.. 13:26:23 evaluator INFO:duckietown-challenges:evaluation: Solution parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 13:26:23 evaluator DEBUG:duckietown-challenges:evaluation: gym started with pid = 90 13:26:23 evaluator INFO:duckietown-challenges:evaluation: Waiting for Gym to activate... 13:26:23 evaluator INFO:duckietown-challenges:evaluation: Preparation done. 13:26:23 evaluator DEBUG:duckietown-challenges:Written to: /challenge-description/description.yaml 13:26:23 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (0 secs passed, will wait 600 secs more) 13:26:23 evaluator launch.sh > Starting xvfb 13:26:23 evaluator launch.sh > Started xvfb with PID 92 13:26:23 evaluator launch.sh > Now running gym_simulation_launcher.py 13:26:24 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 13:26:24 evaluator INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 13:26:24 evaluator INFO:gym-duckietown:gym-duckietown 2018.10.1 13:26:24 evaluator 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_obstacles-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-straight_road-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-zigzag_dists-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_dyn_duckiebots-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_pedestrians-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-test_loop_obstacles-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-udem1-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_empty-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-4way-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop-v0 13:26:24 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop_cw-v0 13:26:24 evaluator WARNING:rosout:Failed to load Python extension for LZ4 support. LZ4 compression will not be available. 13:26:24 evaluator launcher|gym_simulation_launcher.py:48 - main | launcher parameters: 13:26:24 evaluator 13:26:24 evaluator { 13:26:24 evaluator "challenge": "LF", 13:26:24 evaluator "episodes": 5, 13:26:24 evaluator "steps_per_episode": 500, 13:26:24 evaluator "environment-constructor": "Simulator", 13:26:24 evaluator "include_map": true, 13:26:24 evaluator "environment-parameters": { 13:26:24 evaluator "seed": 123, 13:26:24 evaluator "map_name": "loop_empty", 13:26:24 evaluator "max_steps": 500001, 13:26:24 evaluator "domain_rand": 0, 13:26:24 evaluator "camera_width": 640, 13:26:24 evaluator "camera_height": 480, 13:26:24 evaluator "accept_start_angle_deg": 4, 13:26:24 evaluator "full_transparency": true, 13:26:24 evaluator "distortion": true 13:26:24 evaluator }, 13:26:24 evaluator "agent-info": { 13:26:24 evaluator "challenge": "LF" 13:26:24 evaluator } 13:26:24 evaluator } 13:26:24 evaluator launcher|gym_simulation_launcher.py:59 - main | using gym-duckietown version 2018.10.1 13:26:25 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 13:26:25 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 13:26:25 evaluator gym-duckietown| simulator.py:490 - _load_map | loading map file "/workspace/gym-duckietown/gym_duckietown/maps/loop_empty.yaml" 13:26:25 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.obj" 13:26:25 evaluator gym-duckietown| objmesh.py:238 - _load_mtl | loading materials from "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.mtl" 13:26:25 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckie.obj" 13:26:25 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/duckie.png" 13:26:26 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/cone.obj" 13:26:26 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/cone.png" 13:26:26 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/floor_1.png" 13:26:26 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_left_1.png" 13:26:26 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/straight_1.png" 13:26:26 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_right_1.png" 13:26:26 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [4.05833625 0. 2.17835003] 1.62929007381 13:26:29 evaluator launcher|gym_simulation_launcher.py:74 - main | Logging gym state to: /tmp/tmpwVQhwN/episodes 13:26:29 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [2.75442323 0. 3.0079666 ] 4.83604950287 13:26:29 evaluator launcher|gym_simulation_launcher.py:89 - main | Simulator listening to incoming connections... 13:26:29 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep000 13:26:29 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:26:29 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:26:29 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.57449761 0. 1.00806868] 0.0328325810557 13:26:29 evaluator launcher|gym_simulation_launcher.py:237 - run_episode | received ping: {u'topic': 1, u'ip': u'192.168.192.3', u'id': u'2134', u'msg': u'0'} 13:26:29 evaluator launcher|gym_simulation_launcher.py:240 - run_episode | received 2, resetting: {u'topic': 2, u'ip': u'192.168.192.3', u'id': u'2134', u'msg': u'0'} 13:26:29 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.9473256 0. 2.19364627] 4.70207132071 13:26:31 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.621, done=False 13:26:32 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.467, done=False 13:26:33 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-1.003, done=False 13:26:33 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (10 secs passed, will wait 590 secs more) 13:26:34 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, re13:26:22 solution INFO:gym-duckietown-agent:gym-duckietown-agent 2018.10.1 13:26:22 solution INFO:duckietown-challenges:duckietown-challenges 3.2.13 13:26:23 solution DEBUG:duckietown-challenges:Output /challenge-description/description.yaml not ready yet (0 secs passed, will wait 600 secs more) 13:26:24 solution INFO:duckietown-challenges:solution:Parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 13:26:24 solution INFO:duckietown-challenges:solution:Starting. 13:26:24 solution INFO:duckietown-challenges:solution:Creating model. 13:26:24 solution INFO:duckietown-challenges:solution:Making environment 13:26:24 solution INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 13:26:24 solution INFO:duckietown-challenges:solution:Reset environment 13:26:28 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 13:26:52 solution Starting submission 13:26:52 solution (u'starting sub socket on', 8902) 13:26:52 solution [[-6949.509 -2805.532 -6481.555 -5825.258 -4227.846]] 13:26:52 solution [[ -29.29 -160.123 -8.936 -18.853 -195.509]] 13:26:52 solution [[ -18.18 -131.547 -10.692 -15.974 -159.606]] 13:26:52 solution [[ -2.201 -137.987 -9.158 -3.143 -166.401]] 13:26:52 solution [[ -15.868 -133.206 -12.732 -16.583 -159.747]] 13:26:52 solution [[ -6.117 -135.734 -7.265 -5.986 -161.944]] 13:26:52 solution [[ -11.228 -140. -15.408 -25.405 -167.237]] 13:26:52 solution [[ -20.428 -170.803 -12.983 -24.492 -208.346]] 13:26:52 solution [[ -17.688 -171.803 -2.772 -19.31 -206.486]] 13:26:52 solution [[ -3.75 -168.945 2.239 -5.931 -202.138]] 13:26:52 solution [[ -1.723 -171.944 1.172 -3.964 -205.57 ]] 13:26:52 solution [[ -2.998 -167.92 -1.656 -8.662 -200.813]] 13:26:52 solution [[ -3.842 -161.789 -4.163 -9.525 -193.269]] 13:26:52 solution [[ -18.755 -208.212 -10.434 -21.347 -254.407]] 13:26:52 solution [[ -19.588 -198.124 -7.662 -27.7 -241.474]] 13:26:52 solution [[ -18.03 -195.101 -6.758 -18.144 -237.339]] 13:26:52 solution [[ -10.777 -180.781 -7.643 -21.07 -220.106]] 13:26:52 solution [[ -17.739 -174.921 -6.24 -22.923 -211.352]] 13:26:52 solution [[ -13.963 -157.754 1.434 -12.222 -188.705]] 13:26:52 solution [[ -8.571 -129.316 5.044 -5.407 -152.341]] 13:26:52 solution [[ 3.39 -99.307 4.886 1.342 -117.983]] 13:26:52 solution [[ 9.48 -84.109 2.05 6.944 -102.984]] 13:26:52 solution [[ -7.52 -115.275 4.998 -2.017 -137.738]] 13:26:52 solution [[ 5.673 -82.379 2.921 4.451 -100.171]] 13:26:52 solution [[ -15.905 -136.655 2.514 -3.234 -164.826]] 13:26:52 solution [[ 0.748 -94.644 3.044 1.315 -115.461]] 13:26:52 solution [[ 4.285 -67.139 0.515 3.325 -85.661]] 13:26:52 solution [[ -8.054 -109.926 2.518 -1.899 -133.425]] 13:26:52 solution [[ 0.662 -79.121 0.303 1.239 -101.729]] 13:26:52 solution [[ 4.442 -81.361 3.758 5.1 -105.725]] 13:26:52 solution [[ 7.46 -80.329 5.177 7.833 -105.679]] 13:26:52 solution [[ 0.678 -70.598 -3.891 0.323 -92.091]] 13:26:52 solution [[ -13.979 -139.375 -3.807 -1.114 -180.825]] 13:26:52 solution [[ -4.486 -111.298 -5.427 -2.986 -143.927]] 13:26:52 solution [[ -10.645 -119.517 -11.965 -9.337 -153.137]] 13:26:52 solution [[ -17.289 -142.495 -21.433 -17.257 -177.307]] 13:26:52 solution [[ -29.841 -176.797 -44.561 -34.885 -213.16 ]] 13:26:52 solution [[ -20.562 -143.299 -16.643 -17.456 -174.688]] 13:26:52 solution [[ -23.73 -159.223 -38.468 -29.687 -195.447]] 13:26:52 solution [[ -23.164 -145.965 -24.555 -23.09 -180.627]] 13:26:52 solution [[ -28.205 -205.934 -56.872 -41.531 -251.832]] 13:26:52 solution [[ -23.009 -177.984 -39.532 -30.199 -220.411]] 13:26:52 solution [[ -20.664 -162.932 -29.378 -23.715 -206.803]] 13:26:52 solution [[ -22.081 -164.021 -28.716 -23.52 -210.037]] 13:26:52 solution [[ -17.795 -150.965 -18.001 -15.81 -192.877]] 13:26:52 solution [[ -18.556 -173.726 -37.161 -26ward=-0.793, done=False 13:26:35 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.588, done=False 13:26:36 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.538, done=False 13:26:37 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.685, done=False 13:26:38 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.263, done=False 13:26:39 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.535, done=False 13:26:40 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.631, done=False 13:26:41 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.855, done=False 13:26:43 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-1.217, done=False 13:26:43 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (20 secs passed, will wait 580 secs more) 13:26:44 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-1.703, done=False 13:26:45 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-1.819, done=False 13:26:46 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-1.751, done=False 13:26:47 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-1.345, done=False 13:26:48 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.785, done=False 13:26:49 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.655, done=False 13:26:51 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.743, done=False 13:26:52 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.1, done=False 13:26:53 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:26:53 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep000 13:26:53 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:26:53 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep001 13:26:53 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:26:53 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:26:53 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.94220351 0. 1.23114947] 4.68721314392 13:26:53 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (30 secs passed, will wait 570 secs more) 13:26:54 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.584, done=False 13:26:55 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.647, done=False 13:26:56 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.667, done=False 13:26:57 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.705, done=False 13:26:58 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.66, done=False 13:26:59 evalu.566 -224.833]] 13:26:52 solution [[ -21.517 -148.896 -30.171 -25.135 -190.485]] 13:26:52 solution [[ -24.174 -127.482 -33.021 -28.75 -161.948]] 13:26:52 solution [[ -23.517 -118.587 -34.754 -29.52 -149.609]] 13:26:52 solution [[ -22.671 -117.985 -28.205 -25.235 -149.031]] 13:26:52 solution [[ -15.711 -126.158 -20.737 -16.508 -159.57 ]] 13:26:52 solution [[ -14.126 -165.049 -16.205 -10.665 -209.397]] 13:26:52 solution [[ -10.47 -149.726 -26.565 -17.888 -185.426]] 13:26:52 solution [[ -5.381 -158.051 -4.686 -2.717 -196.516]] 13:26:52 solution [[ -2.662 -157.767 -24.665 -13.191 -190.534]] 13:26:52 solution [[ -2.345 -148.609 -1.145 -0.443 -180.366]] 13:26:52 solution [[ 4.671 -149.939 4.471 5.951 -176.326]] 13:26:52 solution [[ 3.754 -154.194 5.402 4.262 -179.439]] 13:26:52 solution [[ 7.762 -162.377 4.75 7.409 -189.534]] 13:26:52 solution [[ 1.43000e-01 -1.57862e+02 2.55200e+00 -4.06900e+00 -1.84453e+02]] 13:26:52 solution [[ 7.688 -157.32 8.552 7.549 -182.636]] 13:26:52 solution [[ -5.378 -162.505 -8.943 -14.599 -189.346]] 13:26:52 solution [[ -4.284 -162.49 -2.771 -11.064 -192.726]] 13:26:52 solution [[ -7.455 -166.548 -5.049 -11.641 -193.398]] 13:26:52 solution [[ -5.016 -171.039 2.639 -8.728 -201.328]] 13:26:52 solution [[ 9.996 -157.131 10.81 9.909 -183.052]] 13:26:52 solution [[ 13.379 -132.682 10.408 13.554 -155.814]] 13:26:52 solution [[ 14.554 -115.876 13.644 14.36 -134.035]] 13:26:52 solution [[ -5.539 -159.012 11.83 0.541 -186.72 ]] 13:26:52 solution [[ 5.253 -127.807 11.004 2.379 -150.064]] 13:26:52 solution [[ 10.711 -94.052 9.593 10.461 -110.321]] 13:26:52 solution [[ -7.782 -151.431 9.367 -2.48 -180.09 ]] 13:26:52 solution [[ 6.646 -102.35 10.058 8.034 -121.545]] 13:26:52 solution [[ 9.498 -78.836 6.756 9.088 -96.076]] 13:26:52 solution [[ 1.376 -118.112 11.619 6.399 -140.718]] 13:26:52 solution [[ 7.093 -76.918 7.909 7.976 -94.258]] 13:26:52 solution [[ 8.365 -68.56 9.955 9.823 -84.879]] 13:26:52 solution [[ 6.741 -74.29 -6.067 3.171 -98.007]] 13:26:52 solution [[ 4.144 -76.996 7.869 6.487 -96.556]] 13:26:52 solution [[ 5.648 -71.919 -2.571 4.344 -95.114]] 13:26:52 solution [[ 0.329 -91.849 5.103 3.354 -114.87 ]] 13:26:52 solution [[ 5.717 -60.973 1.923 5.677 -80.085]] 13:27:17 solution [[ -2.837 -108.105 4.482 2.6 -134.473]] 13:27:17 solution [[ 5.763 -65.383 3.478 6.429 -85.266]] 13:27:17 solution [[ -3.695 -133.074 -29.266 -11.627 -174.522]] 13:27:17 solution [[ 5.267 -87.975 6.561 7.452 -113.694]] 13:27:17 solution [[ 4.305 -99.432 -9.505 0.766 -130.713]] 13:27:17 solution [[ 1.899 -100.135 6.795 7.075 -128.802]] 13:27:17 solution [[ 5.12 -100.231 7.06 7.755 -129.481]] 13:27:17 solution [[ 4.815 -109.734 -9.484 1.234 -144.404]] 13:27:17 solution [[ 1.58 -118.913 5.224 6.479 -152.764]] 13:27:17 solution [[ 3.848 -102.703 4.066 6.091 -132.7 ]] 13:27:17 solution [[ 1.103 -106.3 -8.646 -0.541 -138.299]] 13:27:17 solution [[ -2.463 -120.182 1.642 1.323 -152.238]] 13:27:17 solution [[ 9.79000e-01 -1.04983e+02 -7.16800e+00 -1.30000e-02 -1.36202e+02]] 13:27:17 solution [[ -5.221 -128.908 0.775 0.353 -162.33 ]] 13:27:17 solution [[ -0.953 -116.393 -7.949 -0.982 -150.339]] 13:27:17 solution [[ -7.738 -136.764 -3.589 -2.863 -172.264]] 13:27:17 solution [[ -12.225 -123.689 -4.471 -3.916 -156.125]] 13:27:17 solution [[ -1.242 -110.345 -3.154 0.422 -141.732]] 13:27:17 solution [[ -2.294 -128.936 -20.275 -6.624 -168.261]] 13:27:17 solution [[ -9.242 -145.141 -3.403 0.237 -186.186]] 13:27:17 solution [[ -2.679 -128.981 -7.158 -1.32 -165.871]] 13:27:17 solution [[ -4.425 -132.474 -21.483 -7.779 -172.019]] 13:27:17 solution [[ -18.673 -162.611 -8.383 -5.183 -204.378]] 13:27:17 solution [[ -8.983 -160.595 -11.608 -5.773 -200.196]] 13:27:17 solution [[ -6.507 -181.372 -13.57 -6.167 -222ator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.589, done=False 13:27:01 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.541, done=False 13:27:02 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.494, done=False 13:27:03 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.368, done=False 13:27:03 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (40 secs passed, will wait 560 secs more) 13:27:04 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.912, done=False 13:27:05 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.669, done=False 13:27:07 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.504, done=False 13:27:08 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.474, done=False 13:27:09 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=0.126, done=False 13:27:11 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.13, done=False 13:27:12 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.386, done=False 13:27:13 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.633, done=False 13:27:13 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (50 secs passed, will wait 550 secs more) 13:27:14 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.827, done=False 13:27:15 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-1.24, done=False 13:27:17 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-1.601, done=False 13:27:18 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:27:18 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep001 13:27:18 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:27:18 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep002 13:27:18 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:27:18 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:27:18 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [0.84497723 0. 1.12248482] 4.62469817798 13:27:19 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.135, done=False 13:27:20 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.298, done=False 13:27:21 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.41, done=False 13:27:22 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.484, done=False 13:27:23 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.557, done=False 13:27:23 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (60 secs passed, will wait 540 secs more) 13:27:24 evaluator l.35 ]] 13:27:17 solution [[ -21.568 -224.328 -29.163 -32.81 -264.715]] 13:27:17 solution [[ -44.452 -219.635 -20.511 -42.004 -264.281]] 13:27:17 solution [[ -24.528 -244.551 -57.966 -48.969 -289.423]] 13:27:17 solution [[ -20.287 -193.056 -12.462 -15.047 -229.974]] 13:27:17 solution [[ -7.086 -216.74 -41.457 -30.362 -255.841]] 13:27:17 solution [[ -30.883 -187.001 -18.711 -25.44 -218.991]] 13:27:17 solution [[ -5.735 -202.542 -16.924 -9.546 -237.727]] 13:27:17 solution [[ -43.18 -197.893 -29.885 -33.804 -231.693]] 13:27:17 solution [[ -22.853 -196.742 -19.504 -21.034 -230.534]] 13:27:17 solution [[ -23.892 -204.234 -26.37 -32.36 -239.799]] 13:27:17 solution [[ -35.876 -202.863 -26.523 -43.496 -238.956]] 13:27:17 solution [[ -28.901 -215.137 -28.467 -42.162 -252.646]] 13:27:17 solution [[ -25.825 -223.812 -27.085 -41.172 -264.751]] 13:27:17 solution [[ -30.715 -236.695 -14.425 -38.159 -279.593]] 13:27:17 solution [[ -20.167 -243.246 0.45 -17.438 -285.672]] 13:27:17 solution [[ -17.672 -242.035 0.409 -13.327 -283.417]] 13:27:17 solution [[ -11.232 -197.612 0.516 -19.661 -232.597]] 13:27:17 solution [[ -16.173 -201.121 -11.332 -19.052 -237.43 ]] 13:27:17 solution [[ -16.502 -190.739 -18.836 -29.801 -227.008]] 13:27:17 solution [[ -39.594 -238.877 -9.133 -35.187 -287.725]] 13:27:17 solution [[ -36.831 -225.127 -22.917 -42.439 -273.197]] 13:27:17 solution [[ -36.763 -204.748 -17.868 -43.58 -249.711]] 13:27:17 solution [[ -39.573 -189.246 -16.308 -38.115 -229.787]] 13:27:17 solution [[ -26.958 -178.268 -14.235 -29.067 -214.514]] 13:27:17 solution [[ -17.625 -135.097 -2.02 -23.79 -163.031]] 13:27:17 solution [[ 4.32 -95.882 6.396 4.96 -113.397]] 13:27:17 solution [[ 3.16000e+00 -9.33190e+01 -7.19300e+00 1.09000e-01 -1.17451e+02]] 13:27:17 solution [[ -4.993 -102.09 3.268 -5.023 -122.719]] 13:27:17 solution [[ 3.772 -72.673 2.178 3.26 -90.103]] 13:27:17 solution [[ -20.99 -136.078 -3.156 -12.848 -166.317]] 13:27:17 solution [[ -1.552 -79.107 1.095 -0.806 -98.645]] 13:27:17 solution [[ 6.274 -64.386 0.581 4.961 -85.147]] 13:27:17 solution [[ -13.489 -101.848 -3.578 -6.067 -128.265]] 13:27:17 solution [[ 4.611 -71.28 3.161 4.835 -92.647]] 13:27:17 solution [[ 11.029 -78.577 7.416 10.793 -104.05 ]] 13:27:17 solution [[ -11.256 -133.546 2.528 0.475 -170.902]] 13:27:17 solution [[ 12.059 -82.438 9.117 11.436 -109.184]] 13:27:17 solution [[ 13.186 -157.981 17.62 2.567 -213.138]] 13:27:17 solution [[ 1.47 -105.601 2.036 4.681 -137.95 ]] 13:27:17 solution [[ 4.358 -95.064 1.825 4.85 -124.214]] 13:27:17 solution [[ -2.156 -111.286 -9.524 -3.229 -144.096]] 13:27:17 solution [[ -17.736 -159.752 -10.14 -5.044 -207.104]] 13:27:17 solution [[ -8.127 -149.348 -10.847 -5.227 -193.247]] 13:27:17 solution [[ -9.677 -148.324 -8.806 -7.217 -182. ]] 13:27:17 solution [[ -12.115 -143.917 -16.095 -12.852 -176.275]] 13:27:17 solution [[ -15.357 -159.891 -13.764 -12.91 -197.47 ]] 13:27:17 solution [[ -21.005 -165.898 -38.952 -28.903 -205.28 ]] 13:27:17 solution [[ -17.677 -160.371 -25.283 -19.455 -202.18 ]] 13:27:17 solution [[ -13.461 -153.823 -20.512 -15.039 -195.255]] 13:27:17 solution [[ -11.948 -151.063 -20.219 -12.892 -195.41 ]] 13:27:17 solution [[ -11.106 -142.106 -15.427 -9.749 -182.512]] 13:27:17 solution [[ -6.51 -147.037 -18.05 -9.827 -191.07 ]] 13:27:17 solution [[ -14.783 -137.22 -21.717 -16.922 -175.651]] 13:27:17 solution [[ -15.971 -122.5 -24.297 -19.067 -156.169]] 13:27:17 solution [[ -20.059 -132.175 -29.874 -22.983 -168.093]] 13:27:17 solution [[ -15.396 -133.498 -21.828 -16.554 -168.222]] 13:27:17 solution [[ -18.477 -164.88 -18.158 -14.01 -206.514]] 13:27:17 solution [[ -19.286 -156.68 -39.448 -28.365 -196.199]] 13:27:17 solution [[ -14.48 -177.086 -22.291 -16.229 -218.989]] 13:27:41 solution [[ -30.134 -212.371 -8.235 -10.684 -260.81 ]] 13:27:41 solution [[ -68.137 -212.315 -85.363 -78.658 -274.118]] 13:27:41 solution [[ -31.543 -177.402 -72.566 -68.503 -229.988]] 13:27:41 solution [[-6.90000e-02 -1.35362e+02 -3.33130e+01 -2.29100e+01 -1.70308e+02]] 13:27:41 solution [[ 15.813 -70.592 9.309 14.22 -87.503]] 13:27:41 solution [[ 7.856 -83.748 15.19 10.904 -100.235]] 13:27:41 solution [[ 10.661 -76.365 7.333 10.798 -94.582]] 13:27:41 solution [[ 7.989 -76.871 -0.236 5.822 -96.591]] 13:27:41 solution [[ 1.377 -85.99 7.39 4.278 -104.782]] 13:27:41 solution [[ 5.649 -64.313 0.759 4.364 -82.448]] 13:27:41 solution [[ 0.712 -99.376 8.758 4.05 -119.697]] 13:27:41 solution [[ 5.394 -58.923 4.636 5.769 -75.809]] 13:27:41 solution [[ 0.427 -77.727 -11.382 -3.443 -101.291]] 13:27:41 solution [[ 3.721 -72.095 13.271 7.801 -88.175]] 13:27:41 solution [[ 4.226 -60.457 -4.09 1.168 -79.513]] 13:27:41 solution [[ 3.067 -78.846 13.066 7.641 -96.172]] 13:27:41 solution [[ 1.884 -79.528 -6.672 -0.483 -103.58 ]] 13:27:41 solution [[ 2.299 -89.793 12.297 7.216 -110.308]] 13:27:41 solution [[ 4.212 -66.93 1.078 3.654 -86.859]] 13:27:41 solution [[ 0.2 -105.349 7.592 4.341 -129.438]] 13:27:41 solution [[ 1.374 -83.716 -3.022 0.975 -108.219]] 13:27:41 solution [[ 0.223 -111.173 6.158 4.08 -137.175]] 13:27:41 solution [[ 2.649 -75.976 0.388 3.422 -98.275]] 13:27:41 solution [[ 6.647 -77.463 -5.868 2.778 -102.875]] 13:27:41 solution [[ 1.809 -84.004 8.757 6.038 -106.499]] 13:27:41 solution [[ 3.179 -91.489 -7.969 0.46 -119.971]] 13:27:41 solution [[ -1.727 -92.717 5.402 2.689 -117.915]] 13:27:41 solution [[ 3.317 -80.069 -3.025 2.174 -104.466]] 13:27:41 solution [[ -1.692 -100.841 4.626 2.298 -128.493]] 13:27:41 solution [[ 3.177 -90.497 -1.761 3.09 -117.683]] 13:27:41 solution [[ -5.914 -106.157 1.735 -1.353 -134.48 ]] 13:27:41 solution [[ 0.55 -91.574 -1.011 1.59 -118.268]] 13:27:41 solution [[ -2.286 -102.901 -23.499 -10.938 -133.811]] 13:27:41 solution [[ -5.325 -99.317 1.089 -1.411 -125.637]] 13:27:41 solution [[ -2.805 -117.373 -30.215 -14.509 -151.074]] 13:27:41 solution [[ -5.508 -98.445 3.627 -0.5 -124.023]] 13:27:41 solution [[ 0.82 -96.223 -16.408 -5.883 -125.927]] 13:27:41 solution [[-6.63500e+00 -1.14915e+02 -1.19000e-01 -2.60500e+00 -1.44217e+02]] 13:27:41 solution [[ -0.269 -96.298 -22.787 -10.052 -125.776]] 13:27:41 solution [[ -6.424 -91.937 1.98 -2.321 -115.426]] 13:27:41 solution [[ 0.77 -94.22 -15.7 -5.963 -122.225]] 13:27:41 solution [[ -7.366 -115.628 -1.739 -3.805 -145.841]] 13:27:41 solution [[ 2.774 -91.25 -15.128 -4.854 -118.917]] 13:27:41 solution [[ -6.974 -99.699 2.649 -2.311 -125.166]] 13:27:41 solution [[ -2.614 -104.864 -19.523 -9.396 -135.852]] 13:27:41 solution [[ -7.012 -108.292 1.04 -2.33 -136.352]] 13:27:41 solution [[ -1.572 -109.704 -23.364 -10.711 -142.2 ]] 13:27:41 solution [[ -5.925 -98.781 4.767 -0.52 -123.535]] 13:27:41 solution [[ -5.886 -130.205 -28.502 -14.465 -168.265]] 13:27:41 solution [[ -4.996 -106.495 2.631 -0.246 -134.33 ]] 13:27:41 solution [[ -4.04 -126.989 -25.671 -12.34 -164.527]] 13:27:41 solution [[ -2.828 -96.147 3.168 1.269 -121.724]] 13:27:41 solution [[ -3.523 -134.171 -27.713 -12.953 -172.212]] 13:27:41 solution [[ -1.794 -99.105 4.163 2.221 -125.663]] 13:27:41 solution [[ -1.647 -121.167 -24.164 -10.409 -156.502]] 13:27:41 solution [[ -2.852 -103.5 3.381 1.329 -131.502]] 13:27:41 solution [[ -5.515 -137.705 -34.762 -17.822 -175.264]] 13:27:41 solution [[ -3.03 -107.435 4.058 1.702 -136.417]] 13:27:41 solution [[ -4.407 -123.907 -26.882 -13.522 -158.712]] 13:27:41 solution [[ -4.223 -131.663 -1.124 -1.062 -168.14 ]] 13:27:41 solution [[ -6.183 -116.271 -6.077 -3.937 -148.821]] 13:27:41 solution [[ -8.782 -121.572 -31.046 -17.902 -155.246]] 13:27:41 solution [[ -8.553 -129.245 -1.272 -2.865 -164.915]] 13:27:41 solution [[ auncher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.618, done=False 13:27:26 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.657, done=False 13:27:27 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.667, done=False 13:27:28 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.671, done=False 13:27:29 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.675, done=False 13:27:30 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.679, done=False 13:27:32 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.683, done=False 13:27:33 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.687, done=False 13:27:33 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (70 secs passed, will wait 530 secs more) 13:27:34 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.692, done=False 13:27:35 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.711, done=False 13:27:36 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.708, done=False 13:27:37 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.712, done=False 13:27:38 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.716, done=False 13:27:40 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.72, done=False 13:27:41 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.724, done=False 13:27:42 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:27:42 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep002 13:27:42 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:27:42 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep003 13:27:42 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:27:42 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:27:42 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.00329777 0. 0.86708317] 0.0349480490083 13:27:43 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-1.328, done=False 13:27:43 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (80 secs passed, will wait 520 secs more) 13:27:44 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-1.227, done=False 13:27:45 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.977, done=False 13:27:46 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.865, done=False 13:27:47 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.764, done=False 13:27:49 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.663, done=False 13:27:50 evaluator launcher|gym_simulation_launcher.py:231-10.507 -128.151 -38.762 -22.862 -162.964]] 13:27:41 solution [[ -7.755 -113.74 0.935 -2.821 -144.412]] 13:27:41 solution [[ -9.904 -114.931 -27.415 -16.507 -147.302]] 13:27:41 solution [[ -10.17 -128.722 -1.709 -3.395 -164.336]] 13:27:41 solution [[ -14.477 -123.923 -37.954 -24.578 -157.34 ]] 13:27:41 solution [[ -18.41 -122.461 -7.553 -10.579 -154.147]] 13:27:41 solution [[ -15.592 -140.646 -37.465 -24.578 -177.109]] 13:27:41 solution [[ -24.227 -139.94 -11.136 -13.192 -176.05 ]] 13:27:41 solution [[ -15.694 -139.206 -35.74 -24.312 -174.393]] 13:27:41 solution [[ -28.285 -138.375 -11.496 -15.62 -172.902]] 13:27:41 solution [[ -15.798 -176.1 -36.33 -23.785 -218.312]] 13:27:41 solution [[ -25.515 -155.696 -12.008 -14.267 -194.758]] 13:27:41 solution [[ -9.96 -163.736 -22.246 -13.779 -201.955]] 13:27:41 solution [[ -21.651 -169.822 -5.827 -10.151 -207.908]] 13:27:41 solution [[ -13.335 -183.691 -31.42 -20.901 -222.096]] 13:27:41 solution [[ -19.765 -181.573 -5.098 -8.377 -218.736]] 13:27:41 solution [[ -21.795 -192.486 -41.284 -31.685 -232.602]] 13:27:41 solution [[ -34.627 -194.231 -17.913 -23.355 -233.062]] 13:27:41 solution [[ -31.856 -226.405 -51.841 -48.001 -271.734]] 13:27:41 solution [[ -35.176 -209.485 -33.366 -33.819 -252.376]] 13:28:05 solution [[ -23.826 -221.307 -55.765 -39.661 -264.754]] 13:28:05 solution [[ -45.982 -179.858 -68.365 -63.112 -225.164]] 13:28:05 solution [[ -58.478 -245.652 -45.677 -87.432 -334.153]] 13:28:05 solution [[ -81.148 -268.286 -65.915 -181.213 -378.604]] 13:28:05 solution [[ 9.643 -210.463 14.102 -6.796 -291.9 ]] 13:28:05 solution [[ 10.396 -150.984 10.734 6.331 -201.876]] 13:28:05 solution [[ 3.802 -137.993 -15.505 -2.617 -182.014]] 13:28:05 solution [[ 13.229 -147.839 10.947 9.41 -197.3 ]] 13:28:05 solution [[ 10.652 -191.47 13.25 1.534 -261.319]] 13:28:05 solution [[ 1.963 -141.148 4.525 6.374 -185.539]] 13:28:05 solution [[ 4.15 -118.187 -12.071 -0.485 -156.045]] 13:28:05 solution [[ -9.852 -156.278 -2.741 2.489 -202.432]] 13:28:05 solution [[-4.48000e-01 -1.29136e+02 -6.38000e+00 1.90000e-02 -1.66200e+02]] 13:28:05 solution [[ -8.983 -155.416 -28.835 -16.579 -197.189]] 13:28:05 solution [[ -16.958 -179.597 -4.225 -5.62 -224.996]] 13:28:05 solution [[ -5.82 -185.943 -31.635 -16.552 -229.09 ]] 13:28:05 solution [[ -15.333 -178.357 -9.462 -11.648 -222.115]] 13:28:05 solution [[ -1.394 -189.633 -22.247 -9.924 -228.661]] 13:28:05 solution [[ -19.998 -184.353 -9.742 -12.492 -229.188]] 13:28:05 solution [[ -8.519 -215.296 -40.853 -26.391 -259.614]] 13:28:05 solution [[ -20.822 -173.847 -9.53 -14.77 -213.968]] 13:28:05 solution [[ -3.268 -199.953 -39.046 -26.367 -241.561]] 13:28:05 solution [[ -28.708 -167.793 -16.272 -24.526 -203.7 ]] 13:28:05 solution [[ -5.198 -189.269 -19.766 -13.175 -226.945]] 13:28:05 solution [[ -29.465 -160.868 -18.123 -27.553 -193.868]] 13:28:05 solution [[ -36.17 -184.685 -21.835 -37.337 -221.706]] 13:28:05 solution [[ -30.569 -197.603 -24.713 -38.79 -237.879]] 13:28:05 solution [[ -30.125 -217.419 -35.616 -50.328 -262.626]] 13:28:05 solution [[ -43.86 -200.687 -30.072 -57.652 -242.186]] 13:28:05 solution [[ -45.878 -219.926 -37.652 -58.288 -264.449]] 13:28:05 solution [[ -38.462 -213.869 -23.768 -48.1 -256.828]] 13:28:05 solution [[ -50.8 -222.583 -36.797 -63.368 -265.941]] 13:28:05 solution [[ -59.518 -237.69 -41.757 -68.88 -287.894]] 13:28:05 solution [[ -47.783 -244.027 -28.574 -53.804 -296.513]] 13:28:05 solution [[ -24.088 -242.333 -14.982 -20.759 -294.766]] 13:28:05 solution [[ 0.984 -215.219 -10.015 -7.11 -262.645]] 13:28:05 solution [[ -41.373 -219.654 -10.617 -40.478 -259.904]] 13:28:05 solution [[ -16.496 -220.517 -1.411 -10.123 -263.547]] 13:28:05 solution [[ -6.925 -204.779 -10.637 -15.479 -249.593]] 13:28:05 solution [[ -50.29 -223.152 -8.829 -46.189 -266.477]] 13:28:05 solution [[ -12.138 -206.379 5.356 -3.074 -245.294]] 13:28:05 s - run_episode | step_count=168, reward=-0.468, done=False 13:27:51 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.797, done=False 13:27:52 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.353, done=False 13:27:53 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.678, done=False 13:27:53 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (90 secs passed, will wait 510 secs more) 13:27:54 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.632, done=False 13:27:55 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=0.118, done=False 13:27:56 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.154, done=False 13:27:58 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.287, done=False 13:27:59 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.39, done=False 13:28:00 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.455, done=False 13:28:01 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.5, done=False 13:28:02 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.581, done=False 13:28:03 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.572, done=False 13:28:03 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (100 secs passed, will wait 500 secs more) 13:28:04 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.532, done=False 13:28:05 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:28:05 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep003 13:28:05 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:28:05 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep004 13:28:05 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:28:05 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:28:05 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [1.72410152 0. 3.21929481] 0.0317184229532 13:28:06 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-2.213, done=False 13:28:07 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-2.283, done=False 13:28:09 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-2.352, done=False 13:28:10 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-2.388, done=False 13:28:11 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-2.458, done=False 13:28:12 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-2.528, done=False 13:28:13 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-2.598, done=False 13:28:13 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yamolution [[ 10.114 -172.089 2.29 6.586 -206.657]] 13:28:05 solution [[ -30.173 -202.699 8.194 -18.385 -239.352]] 13:28:05 solution [[ -4.047 -177.795 8.381 3.69 -211.632]] 13:28:05 solution [[ 13.162 -150.642 0.492 8.005 -181.329]] 13:28:05 solution [[ -18.712 -168.458 11.409 -4.719 -199.143]] 13:28:05 solution [[ 10.778 -142.572 7.81 11.651 -170.456]] 13:28:05 solution [[ 12.684 -123.263 11.879 13.885 -147.363]] 13:28:05 solution [[ 9.776 -110.146 9.192 11.451 -135.235]] 13:28:05 solution [[ 8.358 -95.749 7.959 10.318 -120.227]] 13:28:05 solution [[ 4.389 -87.44 2.063 5.618 -112.455]] 13:28:05 solution [[ 6.312 -85.863 -1.677 5.395 -112.864]] 13:28:05 solution [[ 3.711 -123.648 9.358 8.929 -152.252]] 13:28:05 solution [[ 5.183 -92.563 -0.145 5.403 -120.596]] 13:28:05 solution [[ 6.837 -88.285 -3.815 4.869 -116.858]] 13:28:05 solution [[ 3.433 -105.618 9.298 7.374 -131.516]] 13:28:05 solution [[ 5.565 -79.175 -1.713 4.478 -104.191]] 13:28:05 solution [[ 1.279 -112.919 7.142 5.555 -139.682]] 13:28:05 solution [[ 2.098 -83.097 -4.757 1.113 -108.102]] 13:28:05 solution [[ -7.424 -122.694 5.071 1.937 -151.317]] 13:28:05 solution [[ 2.10000e+00 -8.11160e+01 -6.00000e-03 2.82100e+00 -1.04883e+02]] 13:28:05 solution [[ 3.446 -84.194 -6.574 1.329 -110.539]] 13:28:05 solution [[ -8.557 -113.981 0.197 -1.16 -143.702]] 13:28:05 solution [[ 2.454 -86.48 -5.754 1.114 -112.761]] 13:28:05 solution [[ -13.186 -113.485 -2.317 -4.135 -142.88 ]] 13:28:05 solution [[ 2.003 -85.848 -3.934 1.605 -111.643]] 13:28:05 solution [[ -18.972 -138.702 -4.928 -5.034 -175.506]] 13:28:05 solution [[ 1.739 -94.97 -2.243 2.208 -122.908]] 13:28:05 solution [[ 3.537 -103.828 -11.17 0.47 -136.579]] 13:28:05 solution [[ -1.734 -111.713 3.503 4.054 -143.178]] 13:28:05 solution [[ 0.918 -96.789 -0.546 2.51 -124.483]] 13:28:05 solution [[ -0.931 -122.823 -12.704 -2.121 -159.569]] 13:28:05 solution [[ -11.483 -138.952 -5.255 -3.463 -176.487]] 13:28:05 solution [[ -11.995 -149.745 -4.809 -2.77 -188.77 ]] 13:28:05 solution [[ -10.68 -171.802 -9.507 -5.319 -215.589]] 13:28:05 solution [[ -4.392 -180.951 -21.347 -10.413 -222.155]] 13:28:05 solution [[ -38.869 -202.918 -16.994 -21.599 -250.142]] 13:28:05 solution [[ -6.875 -169.096 -14.011 -8.347 -207.458]] 13:28:05 solution [[ -40.508 -186.143 -18.743 -22.737 -228.405]] 13:28:05 solution [[ -22.178 -165.333 -17.222 -20.826 -201.612]] 13:28:05 solution [[ -3.892 -187.177 -24.861 -14.999 -226.992]] 13:28:05 solution [[ -28.141 -159.474 -17.6 -25.68 -193.549]] 13:28:05 solution [[ -28.07 -175.059 -19.014 -29.106 -211.98 ]] 13:28:28 solution [[ -16.436 -181.248 -18.119 -22.745 -220.716]] 13:28:28 solution [[ -50.062 -185.072 -35.679 -62.445 -227.139]] 13:28:28 solution [[ -62.72 -226.059 -66.786 -71.757 -294.232]] 13:28:28 solution [[ -40.586 -237.782 -49.794 -50.192 -297.654]] 13:28:28 solution [[ -68.23 -267.606 -35.564 -77.702 -314.106]] 13:28:28 solution [[ -43.109 -236.849 -51.493 -49.928 -293.813]] 13:28:28 solution [[ -74.805 -266.529 -32.296 -81.238 -310.579]] 13:28:28 solution [[ -45.28 -238.113 -56.353 -48.395 -293.374]] 13:28:28 solution [[ -91.144 -274.525 -40.431 -112.109 -319.191]] 13:28:28 solution [[ -49.185 -243.657 -63.375 -53.26 -297.714]] 13:28:28 solution [[-102.272 -286.588 -53.475 -134.764 -331.664]] 13:28:28 solution [[ -55.492 -251.408 -66.657 -66.635 -306.132]] 13:28:28 solution [[-107.78 -287.65 -58.68 -153.181 -334.31 ]] 13:28:28 solution [[ -79.255 -267.887 -78.3 -110.464 -322.606]] 13:28:28 solution [[ -88.427 -235.818 -99.738 -102.382 -298.192]] 13:28:28 solution [[ -76.75 -260.723 -79.004 -101.669 -313.42 ]] 13:28:28 solution [[-145.944 -306.092 -76.87 -242.1 -355.096]] 13:28:28 solution [[ -81.82 -255.339 -83.337 -117.47 -306.599]] 13:28:28 solution [[-144.689 -286.711 -80.727 -238.366 -330.747]] 13:28:28 solution [[ -77.558 -243.187 -87.567 -114.804 -291.597]] 13:28:28 solution [[-131.566 -267.314 -80.242 -202.474 -308.923]] 13:28:28 solution [[ -79.188 -248.488 -98.982 -136.218 -301.243]] 13:28:28 solution [[-137.168 -277.788 -85.885 -220.467 -323.741]] 13:28:28 solution [[ -82.404 -246.875 -101.266 -133.286 -302.55 ]] 13:28:28 solution [[-115.222 -273.619 -84.462 -176.383 -322.421]] 13:28:28 solution [[ -69.538 -253.396 -104.652 -99.291 -315.872]] 13:28:28 solution [[ -89.758 -264.412 -82.036 -117.24 -319.357]] 13:28:28 solution [[ -93.946 -268.325 -145.287 -157.603 -340.015]] 13:28:28 solution [[ -87.39 -254.527 -82.178 -102.367 -312.182]] 13:28:28 solution [[ -79.196 -251.727 -115.723 -118.2 -323.741]] 13:28:28 solution [[ -60.432 -233.554 -82.457 -81.921 -297.809]] 13:28:28 solution [[ -71.368 -215.75 -67.898 -75.775 -275.592]] 13:28:28 solution [[ -29.1 -200.313 -36.171 -27.226 -259.122]] 13:28:28 solution [[ -12.925 -177.209 -28.848 -18.219 -227.358]] 13:28:28 solution [[ -13.856 -159.792 -18.284 -13.178 -205.864]] 13:28:28 solution [[ -10.582 -166.137 -32.747 -21.241 -216.299]] 13:28:28 solution [[ -22.778 -163.543 -21.852 -18.422 -210.168]] 13:28:28 solution [[ -44.153 -204.059 -45.711 -48.637 -262.521]] 13:28:28 solution [[ -58.949 -206.298 -58.132 -56.777 -262.146]] 13:28:28 solution [[ -43.925 -246.368 -49.762 -49.298 -325.738]] 13:28:28 solution [[ -62.145 -216.143 -43.378 -61.782 -286.012]] 13:28:28 solution [[ -40.762 -253.628 -65.162 -68.697 -337.52 ]] 13:28:28 solution [[ -63.729 -217.064 -48.469 -57.584 -285.205]] 13:28:28 solution [[ -45.96 -243.345 -77.219 -101.133 -323.884]] 13:28:28 solution [[ -57.023 -206.133 -40.815 -44.909 -268.985]] 13:28:28 solution [[ -51.707 -232.539 -75.963 -101.043 -306.645]] 13:28:28 solution [[ -57.879 -200.011 -48.137 -51.413 -256.463]] 13:28:28 solution [[ -72.049 -228.906 -84.238 -136.56 -298.411]] 13:28:28 solution [[ -47.672 -193.947 -43.995 -42.429 -245.715]] 13:28:28 solution [[ -48.035 -191.685 -49.406 -42.153 -240.19 ]] 13:28:28 solution [[-105.847 -252.896 -128.955 -171.767 -324.037]] 13:28:28 solution [[ -61.274 -225.562 -69.861 -82.52 -288.985]] 13:28:28 solution [[ -46.394 -210.177 -58.393 -65.19 -263.578]] 13:28:28 solution [[ -39.091 -205.832 -42.739 -61.751 -257.68 ]] 13:28:28 solution [[ -38.678 -194.738 -55.984 -75.724 -246.812]] 13:28:28 solution [[ -10.83 -172.033 -32.666 -46.248 -212.528]] 13:28:28 solution [[ 7.016 -158.826 0.21 1.493 -187.384]] 13:28:28 solution [[ 6.509 -151.345 6.152 -2.065 -179.756]] 13:28:28 solution [[ 5.757 -188.059 8.52 7.921 -226.173]] 13:28:28 solution [[ -2.985 -172.9 -1.257 -14.513 -210.462]] 13:28:28 solution [[ -5.957 -171.902 -2.149 -17.188 -208.269]] 13:28:28 solution [[-6.72100e+00 -1.68025e+02 1.93000e-01 -1.73010e+01 -1.99025e+02]] 13:28:28 solution [[ -4.644 -137.993 3.971 -15.735 -159.768]] 13:28:28 solution [[ 6.28 -114.739 8.743 5.505 -129.719]] 13:28:28 solution [[ 9.03 -114.83 5.258 6.736 -132.197]] 13:28:28 solution [[ -1.323 -124.107 5.913 -2.486 -142.482]] 13:28:28 solution [[ 1.929 -107.781 5.625 1.898 -124.175]] 13:28:28 solution [[ 2.897 -98.295 -0.402 1.774 -119.674]] 13:28:28 solution [[-7.79700e+00 -1.15270e+02 3.70000e-02 -6.91700e+00 -1.34752e+02]] 13:28:28 solution [[ -5.118 -91.432 -2.263 -4.392 -111.746]] 13:28:28 solution [[ 0.42 -97.607 -8.287 -2.385 -122.562]] 13:28:28 solution [[ -10.861 -86.547 -3.176 -9.01 -105.889]] 13:28:28 solution [[ -3.975 -78.251 -5.197 -4.362 -97.748]] 13:28:28 solution [[ -26.388 -117.575 -10.795 -17.407 -145.673]] 13:28:28 solution [[ -13.235 -80.503 -10.377 -12.205 -100.788]] 13:28:28 solution [[ -7.353 -96.483 -18.613 -11.029 -121.074]] 13:28:28 solution [[ -20.229 -97.574 -12.345 -15.129 -121.465]] 13:28:28 solution [[ -12.634 -89.956 -19.539 -14.764 -115.005]] 13:28:28 solution [[ -33.026 -109.745 -13.099 -19.581 -135.215]] 13:28:28 solution [[ -15.455 -106.557 -l not ready yet (110 secs passed, will wait 490 secs more) 13:28:15 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-2.753, done=False 13:28:16 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-2.994, done=False 13:28:17 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-2.431, done=False 13:28:18 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-1.743, done=False 13:28:19 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.627, done=False 13:28:20 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.036, done=False 13:28:21 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.377, done=False 13:28:23 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.133, done=False 13:28:23 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (120 secs passed, will wait 480 secs more) 13:28:24 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=0.264, done=False 13:28:25 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=0.186, done=False 13:28:26 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.021, done=False 13:28:27 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.156, done=False 13:28:28 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.319, done=False 13:28:29 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:28:29 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep004 13:28:29 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:28:29 evaluator launcher|gym_simulation_launcher.py:140 - main | Simulation done. 13:28:29 evaluator launcher|gym_simulation_launcher.py:152 - main | Clean exit. 13:28:29 evaluator starting pub socket on port 8902 13:28:29 evaluator launcher|gym_simulation_launcher.py:263 - <module> | success 13:28:29 evaluator launch.sh > gym_simulation_launcher terminated with return code 0 13:28:29 evaluator launch.sh > Killing xvfb... 13:28:29 evaluator launch.sh > Killed. 13:28:29 evaluator launch.sh > Graceful exit of launch.sh with return code 0 13:28:34 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (130 secs passed, will wait 470 secs more) 13:28:44 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (140 secs passed, will wait 460 secs more) 13:28:50 evaluator ERROR:duckietown-challenges:declare failed: 13:28:50 evaluator InvalidSubmission: 13:28:50 evaluator Traceback (most recent call last): 13:28:50 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator 13:28:50 evaluator raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION]) 13:28:50 evaluator InvalidSubmission: Invalid solution: 13:28:50 evaluator Traceback (most recent call last): 13:28:50 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution 13:28:50 evaluator raise InvalidSubmission(msg) 13:28:50 evaluator InvalidSubmission: Uncaught exception in solution: 13:28:50 evaluator Traceback (most recent call last): 13:28:50 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution 13:28:50 evaluator solution.run(cis) 13:28:50 evaluator File "solution.py", line 118, in run 13:28:50 evaluator solve(params, cis) 13:28:50 evaluator File "solution.py", line 83, in solve 13:28:50 evaluator observation, reward, done, info = env.step(action) 13:28:50 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step 13:28:50 evaluator return self.env.step(action) 13:28:50 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step 13:28:50 evaluator observation, reward, done, info = self.env.step(action) 13:28:50 evaluator File "/workspace/wrappers.py", line 86, in step 13:28:50 evaluator ob, reward, done, info = self.env.step(action) 13:28:50 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step 13:28:50 evaluator observation, reward, done, info = self.env.step(action) 13:28:50 evaluator File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step 13:28:50 evaluator obs, rew, done, misc = self.sim.step(action, with_observation=True) 13:28:50 evaluator File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step 13:28:50 evaluator return self._failsafe_observe(msg) 13:28:50 evaluator File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe 13:28:50 evaluator raise Exception(msg) 13:28:50 evaluator Exception: Giving up to connect to the gym duckietown server at host: evaluator 13:28:50 evaluator 13:28:50 evaluator 13:28:50 evaluator 13:28:50 evaluator DEBUG:duckietown-challenges:Written to: /challenge-results/challenge_results.yaml