13:21:05 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 13:21:05 evaluator INFO:duckietown-challenges:evaluation: Preparing here.. 13:21:05 evaluator INFO:duckietown-challenges:evaluation: Solution parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 13:21:05 evaluator DEBUG:duckietown-challenges:evaluation: gym started with pid = 26 13:21:05 evaluator INFO:duckietown-challenges:evaluation: Waiting for Gym to activate... 13:21:05 evaluator INFO:duckietown-challenges:evaluation: Preparation done. 13:21:05 evaluator DEBUG:duckietown-challenges:Written to: /challenge-description/description.yaml 13:21:05 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (0 secs passed, will wait 600 secs more) 13:21:05 evaluator launch.sh > Starting xvfb 13:21:05 evaluator launch.sh > Started xvfb with PID 28 13:21:05 evaluator launch.sh > Now running gym_simulation_launcher.py 13:21:05 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 13:21:05 evaluator INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 13:21:06 evaluator INFO:gym-duckietown:gym-duckietown 2018.10.1 13:21:06 evaluator 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-straight_road-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-zigzag_dists-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_pedestrians-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-test_loop_obstacles-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_empty-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_dyn_duckiebots-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-udem1-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop_cw-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-4way-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop-v0 13:21:06 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_obstacles-v0 13:21:06 evaluator WARNING:rosout:Failed to load Python extension for LZ4 support. LZ4 compression will not be available. 13:21:06 evaluator launcher|gym_simulation_launcher.py:48 - main | launcher parameters: 13:21:06 evaluator 13:21:06 evaluator { 13:21:06 evaluator "challenge": "LF", 13:21:06 evaluator "episodes": 5, 13:21:06 evaluator "steps_per_episode": 500, 13:21:06 evaluator "environment-constructor": "Simulator", 13:21:06 evaluator "include_map": true, 13:21:06 evaluator "environment-parameters": { 13:21:06 evaluator "seed": 123, 13:21:06 evaluator "map_name": "loop_empty", 13:21:06 evaluator "max_steps": 500001, 13:21:06 evaluator "domain_rand": 0, 13:21:06 evaluator "camera_width": 640, 13:21:06 evaluator "camera_height": 480, 13:21:06 evaluator "accept_start_angle_deg": 4, 13:21:06 evaluator "full_transparency": true, 13:21:06 evaluator "distortion": true 13:21:06 evaluator }, 13:21:06 evaluator "agent-info": { 13:21:06 evaluator "challenge": "LF" 13:21:06 evaluator } 13:21:06 evaluator } 13:21:06 evaluator launcher|gym_simulation_launcher.py:59 - main | using gym-duckietown version 2018.10.1 13:21:06 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 13:21:06 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 13:21:06 evaluator gym-duckietown| simulator.py:490 - _load_map | loading map file "/workspace/gym-duckietown/gym_duckietown/maps/loop_empty.yaml" 13:21:06 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.obj" 13:21:06 evaluator gym-duckietown| objmesh.py:238 - _load_mtl | loading materials from "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.mtl" 13:21:06 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckie.obj" 13:21:06 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/duckie.png" 13:21:07 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/cone.obj" 13:21:07 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/cone.png" 13:21:07 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/floor_1.png" 13:21:07 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_left_1.png" 13:21:07 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/straight_1.png" 13:21:07 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_right_1.png" 13:21:07 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [4.05833625 0. 2.17835003] 1.62929007381 13:21:10 evaluator launcher|gym_simulation_launcher.py:74 - main | Logging gym state to: /tmp/tmphZjFYG/episodes 13:21:10 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [2.75442323 0. 3.0079666 ] 4.83604950287 13:21:10 evaluator launcher|gym_simulation_launcher.py:89 - main | Simulator listening to incoming connections... 13:21:10 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep000 13:21:10 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:21:10 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:21:10 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.57449761 0. 1.00806868] 0.0328325810557 13:21:10 evaluator launcher|gym_simulation_launcher.py:237 - run_episode | received ping: {u'topic': 1, u'ip': u'172.18.0.3', u'id': u'65997', u'msg': u'0'} 13:21:10 evaluator launcher|gym_simulation_launcher.py:240 - run_episode | received 2, resetting: {u'topic': 2, u'ip': u'172.18.0.3', u'id': u'65997', u'msg': u'0'} 13:21:10 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.9473256 0. 2.19364627] 4.70207132071 13:21:15 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.593, done=False 13:21:15 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (10 secs passed, will wait 590 secs more) 13:21:16 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.505, done=False 13:21:17 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-1.074, done=False 13:21:18 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward13:21:05 solution INFO:gym-duckietown-agent:gym-duckietown-agent 2018.10.1 13:21:05 solution INFO:duckietown-challenges:duckietown-challenges 3.2.13 13:21:05 solution INFO:duckietown-challenges:solution:Parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 13:21:05 solution INFO:duckietown-challenges:solution:Starting. 13:21:05 solution INFO:duckietown-challenges:solution:Creating model. 13:21:05 solution INFO:duckietown-challenges:solution:Making environment 13:21:05 solution INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 13:21:06 solution INFO:duckietown-challenges:solution:Reset environment 13:21:09 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 13:21:13 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 13:21:34 solution Starting submission 13:21:34 solution (u'starting sub socket on', 8902) 13:21:34 solution [[-6949.509 -2805.532 -6481.555 -5825.258 -4227.846]] 13:21:34 solution [[ -30.881 -163.01 -9.711 -19.941 -198.964]] 13:21:34 solution [[ -20.174 -132.967 -11.332 -17.716 -161.221]] 13:21:34 solution [[ -3.931 -136.94 -7.331 -3.879 -163.837]] 13:21:34 solution [[ -8.909 -136.471 -16.503 -17.697 -162.804]] 13:21:34 solution [[ -17.626 -145.676 -18.084 -28.735 -175.329]] 13:21:34 solution [[ -33.101 -189.717 -28.707 -39.191 -231.366]] 13:21:34 solution [[ -25.37 -188.656 -19.327 -31.78 -230.042]] 13:21:34 solution [[ -18.478 -188.001 -2.421 -16.873 -227.964]] 13:21:34 solution [[ -7.353 -187.205 -2.831 -8.434 -226.128]] 13:21:34 solution [[ -8.633 -187.806 -3.638 -13.519 -227.712]] 13:21:34 solution [[ -8.232 -179.204 -1.319 -12.892 -215.798]] 13:21:34 solution [[ -4.247 -172.051 -0.467 -6.353 -207.158]] 13:21:34 solution [[ -11.265 -174.298 -11.188 -21.982 -210.063]] 13:21:34 solution [[ -4.2 -160.281 -5.552 -16.475 -191.426]] 13:21:34 solution [[ -19.623 -210.449 -6.191 -16.502 -256.696]] 13:21:34 solution [[ -12.288 -188.606 -10.557 -22.587 -229.804]] 13:21:34 solution [[ -20.441 -185.724 -9.773 -24.091 -225.374]] 13:21:34 solution [[ -15.263 -165.763 -0.87 -10.544 -199.41 ]] 13:21:34 solution [[ -15.558 -145.224 1.69 -13.84 -173.987]] 13:21:34 solution [[ -4.359 -104.517 4.046 -8.085 -124.662]] 13:21:34 solution [[ 8.813 -78.99 5.028 7.389 -95.846]] 13:21:34 solution [[-1.50340e+01 -1.31888e+02 9.90000e-02 -1.13010e+01 -1.60109e+02]] 13:21:34 solution [[ 2.387 -82.631 4.135 2.512 -99.516]] 13:21:34 solution [[ 7.378 -68.411 2.591 6.196 -86.703]] 13:21:34 solution [[-1.10200e+00 -9.78260e+01 3.26900e+00 -8.70000e-02 -1.18442e+02]] 13:21:34 solution [[ 1.393 -66.224 0.4 1.35 -84.96 ]] 13:21:34 solution [[ -12.466 -129.393 1.528 -2.507 -157.136]] 13:21:34 solution [[ -0.126 -85.56 1.992 1.344 -109.377]] 13:21:34 solution [[ 5.851 -69.7 0.415 5.119 -92.25 ]] 13:21:34 solution [[ -8.76 -97.408 2.334 -0.903 -123.364]] 13:21:34 solution [[ 6.233 -77.049 4.065 6.729 -101.059]] 13:21:34 solution [[ 5.005 -73.274 -0.246 4.694 -96.505]] 13:21:34 solution [[ 1.025 -124.51 2.773 5.273 -162.14 ]] 13:21:34 solution [[ -5.38 -121.719 1.209 3.383 -158.472]] 13:21:34 solution [[ -4.299 -97.187 -4.79 -2.502 -125.439]] 13:21:34 solution [[ -12.507 -112.279 -15.778 -11.826 -143.312]] 13:21:34 solution [[ -17.59 -149.541 -29.751 -22.299 -181.862]] 13:21:34 solution [[ -16.487 -127.57 -17.929 -16.134 -158.021]] 13:21:34 solution [[ -23.342 -145.124 -23.635 -22.212 -176.676]] 13:21:34 solution [[ -24.224 -177.791 -46.792 -34.57 -215.905]] 13:21:34 solution [[ -23.798 -170.195 -29.763 -26.192 -209.853]] 13:21:34 solution [[ -21.921 -178.976 -27.63 -22.81 -225.979]] 13:21:34 solution [[ -20.549 -164.926 -23.007 -19.116 -209.913]] 13:21:34 solution [[ -18.293 -169.157 -35.213 -24.831 -215.7 ]] 13:21:34 solution [[ -21.36 -164.51 -33.95 -26.201 -212.42 ]] 13:21:34 solution=-0.82, done=False 13:21:19 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.642, done=False 13:21:20 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.597, done=False 13:21:21 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.718, done=False 13:21:22 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.141, done=False 13:21:23 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.44, done=False 13:21:24 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.592, done=False 13:21:25 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.827, done=False 13:21:25 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (20 secs passed, will wait 580 secs more) 13:21:26 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-1.131, done=False 13:21:27 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-1.616, done=False 13:21:28 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-1.962, done=False 13:21:29 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-1.911, done=False 13:21:30 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-1.535, done=False 13:21:31 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.973, done=False 13:21:32 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.679, done=False 13:21:33 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.626, done=False 13:21:33 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=0.046, done=False 13:21:34 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:21:34 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep000 13:21:34 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:21:34 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep001 13:21:34 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:21:34 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:21:34 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.94220351 0. 1.23114947] 4.68721314392 13:21:35 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (30 secs passed, will wait 570 secs more) 13:21:35 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.594, done=False 13:21:36 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.621, done=False 13:21:37 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.654, done=False 13:21:38 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.706, done=False 13:21:39 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.672, done=False 13:21:40 evaluator [[ -19.142 -141.753 -26.5 -21.663 -181.813]] 13:21:34 solution [[ -24.781 -139.484 -32.073 -27.655 -177.028]] 13:21:34 solution [[ -25.867 -121.253 -29.404 -28.252 -152.176]] 13:21:34 solution [[ -24.232 -124.628 -30.445 -26.914 -157.201]] 13:21:34 solution [[ -20.368 -139.033 -24.453 -19.565 -176.937]] 13:21:34 solution [[ -19.115 -123.383 -32.749 -26.158 -153.226]] 13:21:34 solution [[ -16.014 -134.513 -28.316 -21.218 -169.273]] 13:21:34 solution [[ -11.258 -161.383 -17.818 -11.847 -202.307]] 13:21:34 solution [[ -30.262 -190.556 -9.551 -12.43 -238.107]] 13:21:34 solution [[ -2.624 -154.194 -4.062 -1.39 -190.351]] 13:21:34 solution [[ -3.904 -170.549 -34.513 -23.772 -205.8 ]] 13:21:34 solution [[ 0.927 -153.44 -1.904 1.178 -184.568]] 13:21:34 solution [[ 5.564 -159.315 2.622 5.871 -187.699]] 13:21:34 solution [[ 5.31 -155.124 6.475 5.63 -179.612]] 13:21:34 solution [[ 6.315 -170.152 2.235 4.354 -199.743]] 13:21:34 solution [[ 2.296 -151.804 7.259 -0.961 -176.276]] 13:21:34 solution [[ 4.689 -162.393 1.554 1.12 -189.129]] 13:21:34 solution [[-4.24800e+00 -1.70625e+02 -1.40000e-02 -9.28600e+00 -2.02476e+02]] 13:21:34 solution [[ -6.212 -166.118 -5.03 -12.386 -194.499]] 13:21:34 solution [[ -2.885 -164.939 -2.748 -10.365 -192.114]] 13:21:34 solution [[ 1.705 -167.018 7.071 0.355 -195.164]] 13:21:34 solution [[ 12.268 -142.822 10.857 12.619 -166.487]] 13:21:34 solution [[ 10.588 -130.633 16.157 9.597 -150.261]] 13:21:34 solution [[ 14.53 -106.727 11.035 13.798 -125.423]] 13:21:34 solution [[ -2.374 -151.226 13.271 4.409 -175.825]] 13:21:34 solution [[ 9.781 -114.47 10.984 9.308 -134.124]] 13:21:34 solution [[ 12.464 -93.513 7.678 11.151 -111.191]] 13:21:34 solution [[ 1.146 -128.929 12.321 7.912 -151.869]] 13:21:34 solution [[ 10.47 -87.504 10.938 10.912 -103.699]] 13:21:34 solution [[ 10.866 -83.147 0.377 7.771 -103.027]] 13:21:34 solution [[ 6.294 -96.015 10.643 8.158 -114.443]] 13:21:34 solution [[ 10.243 -74.27 5.23 9.099 -92.112]] 13:21:34 solution [[ 1.162 -109.065 10.676 5.732 -130.139]] 13:21:34 solution [[ 9.305 -68.418 10.986 10.862 -84.565]] 13:21:34 solution [[ 4.425 -84.82 -13.928 -4.616 -112.016]] 13:21:34 solution [[ 5.227 -72.667 8.643 7.425 -90.555]] 13:21:54 solution [[ 6.343 -70.391 -2.906 4.308 -92.35 ]] 13:21:54 solution [[ 2.529 -89.279 6.273 5.117 -111.497]] 13:21:54 solution [[ -7.952 -145.344 -41.4 -24.2 -193.134]] 13:21:54 solution [[ 2.458 -103.977 -12.669 -1.45 -136.325]] 13:21:54 solution [[ 1.228 -110.315 6.215 6.581 -142.162]] 13:21:54 solution [[ 8.114 -89.616 8.437 10.073 -116.377]] 13:21:54 solution [[ 7.259 -115.173 -10.031 2.231 -152.472]] 13:21:54 solution [[ -0.514 -116.226 5.132 6.44 -149.521]] 13:21:54 solution [[ 6.005 -103.194 4.183 7.528 -134.041]] 13:21:54 solution [[ 4.31 -103.125 -7.386 1.63 -135.296]] 13:21:54 solution [[ 2.661 -115.097 4.392 5.921 -147.481]] 13:21:54 solution [[ 1.529 -92.35 1.434 3.38 -118.997]] 13:21:54 solution [[ 0.504 -102.84 -9.791 -1.506 -133.82 ]] 13:21:54 solution [[-5.57800e+00 -1.34052e+02 -8.40000e-02 6.40000e-01 -1.70135e+02]] 13:21:54 solution [[ -5.737 -113.878 -2.925 -2.209 -143.476]] 13:21:54 solution [[ -3.162 -111.17 -10.181 -3.56 -143.489]] 13:21:54 solution [[ -17.471 -148.095 -7.058 -5.718 -187.154]] 13:21:54 solution [[ -12.41 -131.528 -3.776 -1.918 -167.933]] 13:21:54 solution [[ -1.993 -119.405 -4.055 0.321 -153.428]] 13:21:54 solution [[ -2.931 -119.859 -23.873 -8.784 -156.526]] 13:21:54 solution [[ -20.238 -147.646 -8.42 -6.003 -186.042]] 13:21:54 solution [[ -5.206 -148.391 -8.638 -2.641 -186.94 ]] 13:21:54 solution [[ -1.984 -163.752 -15.29 -3.641 -206.507]] 13:21:54 solution [[ -26.293 -197.206 -6.536 -7.94 -238.736]] 13:21:54 solution [[ -8.106 -198.404 -17.609 -8.242 -243.754]] 13:21: launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.631, done=False 13:21:41 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.6, done=False 13:21:42 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.547, done=False 13:21:43 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.459, done=False 13:21:44 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-1.031, done=False 13:21:45 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.725, done=False 13:21:45 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (40 secs passed, will wait 560 secs more) 13:21:46 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.43, done=False 13:21:47 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.461, done=False 13:21:48 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.48, done=False 13:21:49 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.083, done=False 13:21:50 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.331, done=False 13:21:51 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.566, done=False 13:21:52 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.742, done=False 13:21:53 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-1.105, done=False 13:21:54 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-1.408, done=False 13:21:55 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:21:55 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep001 13:21:55 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:21:55 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep002 13:21:55 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:21:55 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:21:55 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [0.84497723 0. 1.12248482] 4.62469817798 13:21:55 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (50 secs passed, will wait 550 secs more) 13:21:56 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.111, done=False 13:21:57 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.294, done=False 13:21:58 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.406, done=False 13:21:59 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.491, done=False 13:22:00 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.571, done=False 13:22:01 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.622, done=False 13:22:01 evaluator launcher|gym_simulation_launcher.py54 solution [[ -32.79 -211.107 -9.57 -19.656 -255.276]] 13:21:54 solution [[ -13.444 -207.033 -21.542 -18.048 -249.609]] 13:21:54 solution [[ -52.742 -222.388 -21.917 -53.944 -266.724]] 13:21:54 solution [[ -43.837 -228.21 -40.648 -54.717 -272.982]] 13:21:54 solution [[ -36.524 -258.084 -84.129 -72.371 -308.212]] 13:21:54 solution [[ -5.945 -196.949 -19.521 -11.213 -233.374]] 13:21:54 solution [[ -53.415 -214.168 -23.78 -36.637 -253.065]] 13:21:54 solution [[ -24.296 -193.536 -23.141 -24.549 -228.166]] 13:21:54 solution [[ -2.896 -202.049 -18.199 -11.485 -236.135]] 13:21:54 solution [[ -27.283 -188.283 -16.053 -21.308 -219.908]] 13:21:54 solution [[ -17.301 -195.744 -21.693 -21.21 -228.762]] 13:21:54 solution [[ -48.632 -214.458 -39.705 -53.403 -253.293]] 13:21:54 solution [[ -38.275 -209.12 -30.765 -51.734 -245.619]] 13:21:54 solution [[ -27.061 -218.84 -25.26 -37.637 -257.54 ]] 13:21:54 solution [[ -21.475 -217.973 -23.715 -38.056 -256.552]] 13:21:54 solution [[-1.79460e+01 -2.27013e+02 2.36000e-01 -2.31500e+01 -2.66935e+02]] 13:21:54 solution [[ -20.088 -241.699 -2.593 -19.218 -283.855]] 13:21:54 solution [[ -16.76 -215.788 -8.133 -26.067 -254.534]] 13:21:54 solution [[ -19.072 -203.682 -10.127 -23.228 -240.926]] 13:21:54 solution [[ -21.223 -206.986 -18.514 -25.596 -246.274]] 13:21:54 solution [[ -22.073 -185.629 -17.994 -34.82 -222.643]] 13:21:54 solution [[ -23.074 -179.174 -6.868 -20.361 -213.093]] 13:21:54 solution [[-8.49700e+00 -1.55373e+02 1.38000e-01 -8.66300e+00 -1.85588e+02]] 13:21:54 solution [[ 5.064 -131.958 3.984 0.828 -157.37 ]] 13:21:54 solution [[ -27.197 -173.545 -10.232 -25.602 -207.634]] 13:21:54 solution [[ -12.887 -142.692 -1.482 -18.936 -171.675]] 13:21:54 solution [[ -1.387 -108.972 1.667 -7.124 -129.49 ]] 13:21:54 solution [[ 4.143 -99.382 -5.387 1.453 -123.341]] 13:21:54 solution [[ -10.825 -117.606 0.775 -13.742 -141.622]] 13:21:54 solution [[ 4.346 -84.612 2.1 3.409 -102.888]] 13:21:54 solution [[ -19.122 -135.124 -2.298 -14.907 -164.493]] 13:21:54 solution [[ -0.448 -86.105 2.029 0.142 -105.346]] 13:21:54 solution [[ 5.292 -66.414 0.525 4.167 -86.754]] 13:21:54 solution [[ -13.041 -108.204 -1.656 -5.18 -134.068]] 13:21:54 solution [[ 3.666 -72.883 3.206 4.151 -94.206]] 13:21:54 solution [[ 4.943 -85.294 2.695 5.284 -111.064]] 13:21:54 solution [[ 10.074 -83.44 5.127 9.099 -110.239]] 13:21:54 solution [[ 7.328 -137.545 14.7 4.286 -183.143]] 13:21:54 solution [[ 5.448 -83.307 4.914 6.351 -108.881]] 13:21:54 solution [[ 3.846 -84.695 1.73 4.103 -110.342]] 13:21:54 solution [[ -5.089 -116.04 -15.687 -7.163 -150.236]] 13:21:54 solution [[ -10.561 -142.58 -5.344 -1.355 -184.394]] 13:21:54 solution [[ -5.283 -144.108 -8.692 -4.853 -183.772]] 13:21:54 solution [[ -10.378 -152.396 -12.537 -9.394 -185.384]] 13:21:54 solution [[ -16.221 -144.832 -29.473 -21.898 -177.264]] 13:21:54 solution [[ -12.607 -141.073 -14.278 -12.423 -174.107]] 13:21:54 solution [[ -21.139 -166.865 -50.265 -35.354 -205.124]] 13:21:54 solution [[ -22.277 -163.757 -42.308 -31.519 -204.195]] 13:21:54 solution [[ -18.757 -159.508 -35.745 -25.399 -202.891]] 13:21:54 solution [[ -13.774 -156.497 -25.38 -16.628 -202.459]] 13:21:54 solution [[ -10.46 -138.385 -14.709 -10.373 -177.967]] 13:21:54 solution [[ -11.973 -166.291 -34.571 -22.052 -215.119]] 13:21:54 solution [[ -13.406 -150.836 -25.925 -17.401 -194.559]] 13:21:54 solution [[ -17.496 -138.303 -26.544 -20.594 -176.383]] 13:21:54 solution [[ -20.402 -130.089 -40.374 -30.184 -165.121]] 13:21:54 solution [[ -18.975 -125.249 -29.36 -22.856 -159.4 ]] 13:21:54 solution [[ -13.51 -135.107 -21.518 -15.139 -170.776]] 13:22:14 solution [[ -23.435 -187.843 -19.378 -14.972 -234.291]] 13:22:14 solution [[ -12.934 -180.648 -33.891 -22.72 -221.982]] 13:22:14 solution [[ -13.751 -191.025 -11.691 -9.797 -234.358]] 13:22:14 solution [[ -65.035 -211.942 -83.828 -74.458 -273.171]] 13:22:14 solution [[ -24.539 -168.556 -66.863 -58.762 -218.193]] 13:22:14 solution [[ 3.964 -130.529 -28.381 -18.751 -162.315]] 13:22:14 solution [[ 13.395 -77.872 8.107 12.471 -95.508]] 13:22:14 solution [[ 5.614 -93.382 14.834 9.533 -110.753]] 13:22:14 solution [[ 12.106 -68.677 11.879 12.904 -83.733]] 13:22:14 solution [[ 8.473 -66.492 3.423 7.186 -84.077]] 13:22:14 solution [[ 0.995 -92.73 10.719 4.814 -110.563]] 13:22:14 solution [[ 9.096 -61.692 8.464 9.633 -77.936]] 13:22:14 solution [[ 2.906 -65.003 -7.269 -0.693 -85.173]] 13:22:14 solution [[ 4.107 -75.075 12.379 7.798 -92.283]] 13:22:14 solution [[ 3.644 -62.377 -2.46 1.635 -81.499]] 13:22:14 solution [[ 1.976 -72.967 12.545 6.219 -88.511]] 13:22:14 solution [[ 2.956 -71.93 -1.507 2.01 -93.508]] 13:22:14 solution [[ 1.778 -89.677 10.524 5.941 -109.555]] 13:22:14 solution [[ 2.864 -73.964 0.343 2.757 -95.532]] 13:22:14 solution [[ 0.549 -100.796 9.801 4.952 -122.323]] 13:22:14 solution [[ 2.023 -81.096 -0.452 2.404 -104.473]] 13:22:14 solution [[ 4.441 -80.478 -7.409 0.904 -106.526]] 13:22:14 solution [[ 3.954 -94.998 8.504 7.418 -118.787]] 13:22:14 solution [[ 5.995 -77.348 -3.584 3.551 -102.065]] 13:22:14 solution [[ 2.208 -88.633 9.427 6.39 -111.133]] 13:22:14 solution [[ 4.15 -82.362 -3.381 2.707 -108.013]] 13:22:14 solution [[ 0.524 -95.26 6.686 4.404 -120.858]] 13:22:14 solution [[ 2.714 -81.729 -0.792 2.701 -106.011]] 13:22:14 solution [[ -2.599 -96.372 5.232 1.721 -121.099]] 13:22:14 solution [[ -0.54 -96.249 -3.773 -0.137 -124.001]] 13:22:14 solution [[ 5.70000e-02 -9.71640e+01 -1.41770e+01 -4.61800e+00 -1.27428e+02]] 13:22:14 solution [[ -1.853 -96.204 5.015 2.835 -122.288]] 13:22:14 solution [[ -0.237 -99.747 -18.087 -7.179 -130.051]] 13:22:14 solution [[ -3.016 -96.137 6.795 2.385 -120.444]] 13:22:14 solution [[ -3.662 -113.718 -20.4 -9.833 -146.57 ]] 13:22:14 solution [[-5.25900e+00 -1.08583e+02 3.86800e+00 9.80000e-02 -1.36414e+02]] 13:22:14 solution [[ -0.139 -93.262 -12.585 -4.553 -121.173]] 13:22:14 solution [[ -3.568 -107.457 6.642 2.022 -134.525]] 13:22:14 solution [[ -4.522 -110.603 -23.499 -12.164 -142.506]] 13:22:14 solution [[ -7.339 -103.72 2.548 -2.161 -130.63 ]] 13:22:14 solution [[ -2.045 -91.001 -13.091 -6.117 -118.009]] 13:22:14 solution [[ -6.23 -118.021 1.893 -1.614 -148.442]] 13:22:14 solution [[ -1.944 -104.466 -17.614 -8.276 -134.858]] 13:22:14 solution [[ -3.577 -93.931 6.99 1.467 -118.147]] 13:22:14 solution [[ -3.098 -98.444 -14.638 -7.981 -127.221]] 13:22:14 solution [[ -3.698 -116.671 2.44 0.223 -148.356]] 13:22:14 solution [[ 1.17 -106.807 -16.452 -6.328 -138.267]] 13:22:14 solution [[ -2.114 -114.768 7.942 3.611 -143.865]] 13:22:14 solution [[ -1.666 -112.076 -14.213 -6.065 -145.13 ]] 13:22:14 solution [[ -3.979 -119.536 3.716 1.09 -150.591]] 13:22:14 solution [[ -0.483 -113.133 -16.431 -6.634 -146.326]] 13:22:14 solution [[ -3. -115.596 4.083 2.19 -145.205]] 13:22:14 solution [[ 1.255 -108.084 -9.888 -1.667 -141.13 ]] 13:22:14 solution [[ -1.811 -120.128 4.346 2.729 -153.065]] 13:22:14 solution [[ 0.82 -110.869 -10.597 -2.377 -143.991]] 13:22:14 solution [[ -4.636 -113.686 4.957 1.148 -143.892]] 13:22:14 solution [[ -4.787 -128.643 -17.427 -8.072 -166.009]] 13:22:14 solution [[ -1.798 -118.371 6.583 3.498 -150.664]] 13:22:14 solution [[ -3.479 -117.506 -11.364 -4.805 -151.546]] 13:22:14 solution [[ -3.504 -119.757 4.974 1.725 -152.322]] 13:22:14 solution [[ -7.336 -135.375 -17.977 -9.486 -173.876]] 13:22:14 solution [[ -4.321 -128.329 4.104 0.902 -163.265]] 13:22:14 solution [[ -7.118 -123.192 -12.005 -6.857 -158.162]] 13:22:14 solution [[ -10.067 -139.75 -39.699 -22.728 -177.589]] 13:22:14 solution [[ -10.938 -110.465 -4.113 -6.46 -139.502]] 13:2:231 - run_episode | step_count=168, reward=-0.65, done=False 13:22:02 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.666, done=False 13:22:03 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.681, done=False 13:22:04 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.697, done=False 13:22:05 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (60 secs passed, will wait 540 secs more) 13:22:05 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.713, done=False 13:22:06 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.728, done=False 13:22:07 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.744, done=False 13:22:08 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.76, done=False 13:22:09 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.77, done=False 13:22:10 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.735, done=False 13:22:11 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.716, done=False 13:22:12 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.712, done=False 13:22:13 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.728, done=False 13:22:14 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.743, done=False 13:22:15 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:22:15 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep002 13:22:15 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:22:15 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep003 13:22:15 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:22:15 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:22:15 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.00329777 0. 0.86708317] 0.0349480490083 13:22:15 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (70 secs passed, will wait 530 secs more) 13:22:16 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-1.301, done=False 13:22:17 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-1.2, done=False 13:22:18 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.993, done=False 13:22:19 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.875, done=False 13:22:20 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.809, done=False 13:22:21 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.707, done=False 13:22:22 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.52, done=False 13:22:23 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192:14 solution [[ -14.425 -157.586 -43.935 -27.767 -198.864]] 13:22:14 solution [[ -10.151 -112.238 -4.13 -5.968 -141.912]] 13:22:14 solution [[ -13.076 -141.501 -37.483 -22.81 -178.852]] 13:22:14 solution [[ -9.989 -106.928 -4.819 -6.462 -135.566]] 13:22:14 solution [[ -17.934 -152.359 -48.949 -34.535 -192.425]] 13:22:14 solution [[ -15.734 -111.153 -9.636 -11.729 -139.322]] 13:22:14 solution [[ -15.325 -152.102 -46.409 -30.796 -189.543]] 13:22:14 solution [[ -17.127 -132.544 -15.114 -14.35 -167.083]] 13:22:14 solution [[ -17.407 -156.62 -24.256 -18.127 -196.425]] 13:22:14 solution [[ -28.228 -164.45 -13.96 -15.2 -207.089]] 13:22:14 solution [[ -12.444 -164.642 -23.328 -15.759 -204.495]] 13:22:14 solution [[ -30.021 -169.07 -9.457 -13.621 -209.045]] 13:22:14 solution [[ -16.905 -191.013 -26.188 -19.3 -233.157]] 13:22:14 solution [[ -19.029 -184.592 -4.199 -8.082 -223.63 ]] 13:22:14 solution [[ -23.713 -189.434 -38.817 -32.406 -228.412]] 13:22:14 solution [[ -33.222 -193.099 -12.864 -17.881 -232.329]] 13:22:14 solution [[ -20.694 -194.608 -33.762 -26.387 -234.714]] 13:22:14 solution [[ -43.314 -226.004 -27.49 -31.1 -273.039]] 13:22:14 solution [[ -26.043 -213.009 -51.855 -39.041 -256.038]] 13:22:35 solution [[ -36.609 -206.682 -36.754 -37.65 -249.733]] 13:22:35 solution [[ -47.938 -223.704 -30.954 -39.232 -270.319]] 13:22:35 solution [[ -12.194 -205.733 -18.589 -31.848 -279.014]] 13:22:35 solution [[ -70.992 -260.424 -56.364 -143.854 -362.278]] 13:22:35 solution [[ -35.284 -245.86 -29.968 -102.995 -341.827]] 13:22:35 solution [[ 20.307 -178.394 21.68 7.471 -244.316]] 13:22:35 solution [[ 7.623 -125.556 -3.591 4.47 -165.938]] 13:22:35 solution [[ 14.617 -178.916 14.795 7.229 -241.595]] 13:22:35 solution [[ 8.901 -132.184 -6.181 4.22 -175.185]] 13:22:35 solution [[ 6.27 -157.486 7.547 4.939 -209.675]] 13:22:35 solution [[ 8.108 -128.336 -8.764 2.684 -170.335]] 13:22:35 solution [[ 2.824 -159.519 3.543 4.532 -210.685]] 13:22:35 solution [[ 1.911 -140.148 -4.114 3.952 -183.154]] 13:22:35 solution [[ -3.749 -134.554 -21.901 -8.092 -173.882]] 13:22:35 solution [[ -13.979 -171.546 -9.867 -5.858 -219.83 ]] 13:22:35 solution [[ -2.363 -182.865 -10.579 -2.781 -229.595]] 13:22:35 solution [[ -26.528 -184.074 -7.172 -12.814 -231.079]] 13:22:35 solution [[ -8.089 -188.619 -19.59 -12.554 -232.426]] 13:22:35 solution [[ -21.806 -171.76 -4.306 -11.37 -212.038]] 13:22:35 solution [[ -20.472 -203.297 -36.076 -28.571 -248.446]] 13:22:35 solution [[ -36.264 -190.199 -16.892 -24.787 -235.301]] 13:22:35 solution [[ -16.271 -178.29 -23.401 -21.242 -216.949]] 13:22:35 solution [[ -38.324 -178.299 -16.8 -25.611 -218.736]] 13:22:35 solution [[ -23.386 -169.7 -14.766 -21.09 -205.254]] 13:22:35 solution [[ -11.6 -202.914 -32.241 -29.313 -243.285]] 13:22:35 solution [[ -30.089 -172.131 -14.946 -25.933 -206.571]] 13:22:35 solution [[ -29.125 -190.325 -19.002 -30.696 -226.647]] 13:22:35 solution [[ -31.343 -214.763 -33.771 -44.87 -259.05 ]] 13:22:35 solution [[ -44.334 -188.833 -29.934 -57.555 -227.257]] 13:22:35 solution [[ -47.293 -208.509 -26.53 -55.551 -251.184]] 13:22:35 solution [[ -47.084 -225.365 -34.642 -55.76 -269.626]] 13:22:35 solution [[ -55.82 -231.793 -34.793 -64.49 -278.444]] 13:22:35 solution [[ -60.253 -233.792 -44.477 -72.901 -280.68 ]] 13:22:35 solution [[ -63.093 -249.825 -49.919 -79.758 -304.932]] 13:22:35 solution [[ -43.851 -249.696 -30.044 -50.086 -306.068]] 13:22:35 solution [[ -15.872 -238.329 -17.298 -17.777 -292.936]] 13:22:35 solution [[ -46.138 -229.699 -11.046 -40.822 -273.417]] 13:22:35 solution [[ -24.176 -218.836 1.533 -15.998 -259.476]] 13:22:35 solution [[ -2.874 -205.843 -3.562 -5.996 -248.705]] 13:22:35 solution [[ -56.287 -227.864 -21.782 -47.84 -269.778]] 13:22:35 solution [[ -25.498 -210.811 1.52 -21.532 -250.622]] 13:22:35 solution [[ 4.569 -190.693 0.426 5.231 -229.026]] 13:22:35 solu2, reward=-0.817, done=False 13:22:24 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.377, done=False 13:22:25 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.689, done=False 13:22:25 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (80 secs passed, will wait 520 secs more) 13:22:26 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=0.328, done=False 13:22:26 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.083, done=False 13:22:27 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.249, done=False 13:22:28 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.345, done=False 13:22:29 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.438, done=False 13:22:30 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.483, done=False 13:22:31 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.561, done=False 13:22:32 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.558, done=False 13:22:33 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.551, done=False 13:22:34 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.478, done=False 13:22:35 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (90 secs passed, will wait 510 secs more) 13:22:35 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:22:35 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep003 13:22:35 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:22:35 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep004 13:22:35 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 13:22:35 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 13:22:35 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [1.72410152 0. 3.21929481] 0.0317184229532 13:22:36 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-2.201, done=False 13:22:37 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-2.259, done=False 13:22:38 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-2.317, done=False 13:22:39 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-2.376, done=False 13:22:40 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-2.434, done=False 13:22:41 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-2.492, done=False 13:22:42 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-2.612, done=False 13:22:43 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-2.739, done=False 13:22:44 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-3.032, done=False 13:22tion [[ -5.222 -174.322 9.736 2.307 -207.166]] 13:22:35 solution [[ 13.461 -148.179 2.572 9.951 -177.808]] 13:22:35 solution [[ -21.551 -171.003 11.394 -6.262 -202.163]] 13:22:35 solution [[ 9.291 -140.808 9.273 11.543 -168.133]] 13:22:35 solution [[ 12.19 -122.385 12.706 14.008 -146.164]] 13:22:35 solution [[ 8.922 -109.975 8.999 10.793 -135.048]] 13:22:35 solution [[ 8.488 -94.957 8.84 10.69 -119.159]] 13:22:35 solution [[ 4.409 -88.014 3.002 5.934 -112.587]] 13:22:35 solution [[ 6.298 -84.244 -0.382 5.86 -110.5 ]] 13:22:35 solution [[ 1.256 -128.144 8.245 7.816 -157.898]] 13:22:35 solution [[ 4.63000e+00 -9.41210e+01 -7.90000e-02 5.11900e+00 -1.22386e+02]] 13:22:35 solution [[ 7.631 -85.705 -2.063 6.02 -113.366]] 13:22:35 solution [[ 2.132 -109.412 7.814 6.093 -136.294]] 13:22:35 solution [[ 5.604 -77.874 -0.887 4.793 -102.291]] 13:22:35 solution [[ -0.742 -116.878 6.543 4.758 -144.314]] 13:22:35 solution [[ 2.237 -82.002 -3.71 1.549 -106.513]] 13:22:35 solution [[ -9.011 -126.076 5.207 1.782 -155.282]] 13:22:35 solution [[ 1.865 -80.88 0.71 2.94 -104.357]] 13:22:35 solution [[ 3.011 -84.052 -5.895 1.379 -110.037]] 13:22:35 solution [[ -10.601 -117.362 -0.244 -1.886 -147.768]] 13:22:35 solution [[ 2.368 -86.655 -5.148 1.296 -112.834]] 13:22:35 solution [[ -14.398 -116.531 -2.878 -4.681 -146.517]] 13:22:35 solution [[ 2.17 -84.546 -2.539 2.199 -109.764]] 13:22:35 solution [[ 2.429 -96.31 -13.074 -1.461 -127.141]] 13:22:35 solution [[ -4.966 -117.186 2.043 3.17 -150.376]] 13:22:35 solution [[ 1.543 -90.415 0.587 3.329 -116.45 ]] 13:22:35 solution [[ 1.037 -104.73 -11.273 -0.912 -136.673]] 13:22:35 solution [[ -11.022 -130.779 -0.374 1.114 -166.989]] 13:22:35 solution [[ -6.727 -127.215 -5.174 -2.635 -161.654]] 13:22:35 solution [[ -8.641 -162.713 -13.977 -7.388 -207.352]] 13:22:35 solution [[ -3.262 -179.102 -17.842 -6.907 -222.718]] 13:22:35 solution [[ -13.573 -173.422 -0.418 -2.194 -213.113]] 13:22:35 solution [[ -4.673 -180.136 -24.068 -12.109 -220.776]] 13:22:35 solution [[ -35.163 -198.833 -14.623 -19.176 -244.85 ]] 13:22:35 solution [[ -4.226 -168.816 -16.472 -8.229 -207.199]] 13:22:35 solution [[ -36.35 -180.629 -15.744 -21.084 -221.177]] 13:22:35 solution [[ -19.791 -165.031 -17.281 -19.08 -201.56 ]] 13:22:35 solution [[ -3.085 -185.307 -24.577 -14.731 -224.805]] 13:22:35 solution [[ -25.844 -157.763 -16.055 -23.325 -191.398]] 13:22:35 solution [[ -24.105 -172.259 -17.373 -25.284 -208.308]] 13:22:35 solution [[ -14.335 -180.379 -17.675 -20.923 -219.78 ]] 13:22:55 solution [[ -46.325 -181.737 -35.008 -60.27 -222.754]] 13:22:55 solution [[ -34.713 -188.189 -29.73 -49.324 -229.831]] 13:22:55 solution [[ -33.78 -196.148 -31.809 -46.281 -239.642]] 13:22:55 solution [[ -61.847 -223.325 -65.638 -69.802 -291.265]] 13:22:55 solution [[ -40.13 -236.541 -49.146 -51.151 -296.339]] 13:22:55 solution [[ -52.121 -257.7 -29.573 -60.844 -306.257]] 13:22:55 solution [[ -44.441 -235.328 -52.381 -55.022 -293.543]] 13:22:55 solution [[ -59.248 -258.377 -29.373 -68.095 -305.446]] 13:22:55 solution [[ -48.34 -233.701 -59.203 -58.732 -290.461]] 13:22:55 solution [[ -68.589 -260.765 -30.873 -75.292 -307.243]] 13:22:55 solution [[ -54.721 -240.336 -68.894 -62.227 -295.332]] 13:22:55 solution [[ -78.864 -269.343 -41.162 -88.217 -315.167]] 13:22:55 solution [[ -62.226 -245.56 -77.772 -72.604 -301.472]] 13:22:55 solution [[ -81.372 -273.744 -41.419 -95.645 -321.427]] 13:22:55 solution [[ -77.941 -256.386 -85.692 -102.623 -310.983]] 13:22:55 solution [[-112.176 -293.893 -52.519 -162.579 -342.536]] 13:22:55 solution [[ -87.958 -256.84 -90.554 -121.195 -311.177]] 13:22:55 solution [[-121.929 -287.81 -65.379 -185.237 -335.234]] 13:22:55 solution [[ -86.102 -248.647 -89.961 -120.056 -300.038]] 13:22:55 solution [[-130.569 -279.138 -77.655 -207.446 -323.276]] 13:22:55 solution [[ -75.976 -233.834 -92.502 -105.605 -284.749]] 13:22:55 solution [[-114.377 -258.307 -79.765 -173.53 -300.682]] 13:22:55 solution [[ -76.227 -243.513 -104.435 -126.224 -299.457]] 13:22:55 solution [[-117.156 -269.511 -90.871 -184.231 -317.526]] 13:22:55 solution [[ -84.611 -243.181 -107.68 -121.887 -303.499]] 13:22:55 solution [[-107.64 -267.762 -94.788 -165.584 -319.496]] 13:22:55 solution [[ -69.355 -254.987 -102.434 -95.257 -319.225]] 13:22:55 solution [[ -78.595 -259.209 -79.593 -94.833 -314.047]] 13:22:55 solution [[-119.206 -270.686 -79.481 -157.975 -322.827]] 13:22:55 solution [[ -78.059 -251.176 -91.857 -105.016 -311.12 ]] 13:22:55 solution [[ -87.463 -240.16 -77.464 -92.794 -295.514]] 13:22:55 solution [[ -61.201 -238.233 -85.261 -82.337 -305.171]] 13:22:55 solution [[ -71.639 -215.708 -69.962 -78.286 -275.699]] 13:22:55 solution [[ -23.292 -199.623 -36.643 -24.811 -258.827]] 13:22:55 solution [[ -36.941 -188.115 -27.209 -20.558 -241.318]] 13:22:55 solution [[ -13.286 -154.591 -17.337 -12.745 -199.236]] 13:22:55 solution [[ -9.372 -169.275 -26.932 -16.748 -220.864]] 13:22:55 solution [[ -23.945 -168.546 -22.36 -19.112 -216.669]] 13:22:55 solution [[ -46.651 -211.929 -50.513 -55.642 -273.383]] 13:22:55 solution [[ -61.481 -211.489 -60.933 -58.93 -268.697]] 13:22:55 solution [[ -43.046 -248.745 -46.794 -45.85 -328.612]] 13:22:55 solution [[ -63.481 -211.837 -48.022 -56.331 -276.756]] 13:22:55 solution [[ -39.735 -253.301 -62.699 -59.726 -336.829]] 13:22:55 solution [[ -60.209 -207.303 -42.052 -43.968 -269.084]] 13:22:55 solution [[ -42.912 -244.215 -77.192 -99.493 -325.569]] 13:22:55 solution [[ -51.994 -195.432 -36.574 -35.715 -251.943]] 13:22:55 solution [[ -52.576 -189.059 -47.091 -45.715 -240.805]] 13:22:55 solution [[ -85.533 -238.363 -115.39 -179.121 -307.739]] 13:22:55 solution [[ -43.38 -192.457 -44.85 -39.815 -241.058]] 13:22:55 solution [[ -82.351 -237.091 -87.829 -118.55 -305.708]] 13:22:55 solution [[ -56.524 -223.059 -65.737 -75.745 -283.828]] 13:22:55 solution [[ -46.143 -215.622 -56.739 -63.727 -269.95 ]] 13:22:55 solution [[ -42.285 -200.145 -50.749 -75.526 -254.354]] 13:22:55 solution [[ -36.698 -187.191 -60.097 -80.264 -239.067]] 13:22:55 solution [[ 0.219 -170.297 -22.898 -24.612 -206.99 ]] 13:22:55 solution [[ 4.174 -164.277 -1.258 -3.519 -194.926]] 13:22:55 solution [[ -0.289 -160.995 2.751 -10.849 -193.658]] 13:22:55 solution [[ 8.101 -160.26 4.434 5.842 -189.901]] 13:22:55 solution [[ -3.71 -179.001 0.432 -14.105 -218.651]] 13:22:55 solution [[ -11.116 -179.21 -6.724 -21.202 -220.25 ]] 13:22:55 solution [[ -14.751 -180.534 -6.056 -25.271 -218.722]] 13:22:55 solution [[ 1.955 -148.669 9.287 -0.885 -172.678]] 13:22:55 solution [[ 0.398 -131.285 5.722 0.79 -150.925]] 13:22:55 solution [[ 6.486 -110.53 6.799 4.809 -125.01 ]] 13:22:55 solution [[ 9.742 -98.935 4.577 7.537 -117.516]] 13:22:55 solution [[ -3.225 -119.174 3.46 -2.807 -136.769]] 13:22:55 solution [[ 2.852 -98.09 2.201 1.88 -117.564]] 13:22:55 solution [[ -15.588 -138.047 -1.734 -9.956 -161.54 ]] 13:22:55 solution [[ -8.051 -101.6 -0.756 -6.242 -123.084]] 13:22:55 solution [[ -1.2 -84.806 -0.983 -0.804 -105.502]] 13:22:55 solution [[ -8.733 -79.548 -8.693 -8.215 -100.542]] 13:22:55 solution [[ -10.354 -80.816 -11.64 -10.18 -101.791]] 13:22:55 solution [[ -15.082 -116.4 -21.045 -15.791 -146.901]] 13:22:55 solution [[ -27.309 -119.79 -11.028 -16.007 -149.385]] 13:22:55 solution [[ -16.374 -120.039 -17.337 -14.9 -151.092]] 13:22:55 solution [[ -12.925 -152.748 -28.965 -18.944 -186.807]] 13:22:55 solution [[ -18.122 -158.474 -10.506 -12.213 -193.372]] 13:22:55 solution [[ -20.097 -155.679 -33.365 -25.447 -188.907]] 13:22:55 solution [[ -30.766 -191.731 -20.765 -20.019 -235.241]] 13:22:55 solution [[ -23.532 -164.547 -29.177 -25.239 -200.25 ]] 13:22:55 solution [[ -29.049 -186.674 -28.856 -26.74 -228.874]] 13:22:55 so:45 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-2.448, done=False 13:22:45 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (100 secs passed, will wait 500 secs more) 13:22:46 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-1.39, done=False 13:22:47 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=0.076, done=False 13:22:48 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.239, done=False 13:22:49 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.4, done=False 13:22:50 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=0.114, done=False 13:22:51 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=0.295, done=False 13:22:52 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.026, done=False 13:22:53 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.274, done=False 13:22:54 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.403, done=False 13:22:55 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.674, done=False 13:22:55 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (110 secs passed, will wait 490 secs more) 13:22:56 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 13:22:56 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep004 13:22:56 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 13:22:56 evaluator launcher|gym_simulation_launcher.py:140 - main | Simulation done. 13:22:56 evaluator launcher|gym_simulation_launcher.py:152 - main | Clean exit. 13:22:56 evaluator launcher|gym_simulation_launcher.py:263 - <module> | success 13:22:56 evaluator starting pub socket on port 8902 13:22:56 evaluator launch.sh > gym_simulation_launcher terminated with return code 0 13:22:56 evaluator launch.sh > Killing xvfb... 13:22:56 evaluator launch.sh > Killed. 13:22:56 evaluator launch.sh > Graceful exit of launch.sh with return code 0 13:23:05 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (120 secs passed, will wait 480 secs more) 13:23:15 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (130 secs passed, will wait 470 secs more) 13:23:16 evaluator ERROR:duckietown-challenges:declare failed: 13:23:16 evaluator InvalidSubmission: 13:23:16 evaluator Traceback (most recent call last): 13:23:16 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator 13:23:16 evaluator raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION]) 13:23:16 evaluator InvalidSubmission: Invalid solution: 13:23:16 evaluator Traceback (most recent call last): 13:23:16 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution 13:23:16 evaluator raise InvalidSubmission(msg) 13:23:16 evaluator InvalidSubmission: Uncaught exception in solution: 13:23:16 evaluator Traceback (most recent call last): 13:23:16 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution 13:23:16 evaluator solution.run(cis) 13:23:16 evaluator File "solution.py", line 118, in run 13:23:16 evaluator solve(params, cis) 13:23:16 evaluator File "solution.py", line 83, in solve 13:23:16 evaluator observation, reward, done, info = env.step(action) 13:23:16 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step 13:23:16 evaluator return self.env.step(action) 13:23:16 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step 13:23:16 evaluator observation, reward, done, info = self.env.step(action) 13:23:16 evaluator File "/workspace/wrappers.py", line 86, in step 13:23:16 evaluator ob, reward, done, info = self.env.step(action) 13:23:16 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step 13:23:16 evaluator observation, reward, done, info = self.env.step(action) 13:23:16 evaluator File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step 13:23:16 evaluator obs, rew, done, misc = self.sim.step(action, with_observation=True) 13:23:16 evaluator File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step 13:23:16 evaluator return self._failsafe_observe(msg) 13:23:16 evaluator File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe 13:23:16 evaluator raise Exception(msg) 13:23:16 evaluator Exception: Giving up to connect to the gym duckietown server at host: evaluator 13:23:16 evaluator 13:23:16 evaluator 13:23:16 evaluator 13:23:16 evaluator DEBUG:duckietown-challenges:Written to: /challenge-results/challenge_results.yaml