15:13:38 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 15:13:39 evaluator INFO:duckietown-challenges:evaluation: Preparing here.. 15:13:39 evaluator INFO:duckietown-challenges:evaluation: Solution parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 15:13:39 evaluator DEBUG:duckietown-challenges:evaluation: gym started with pid = 25 15:13:39 evaluator INFO:duckietown-challenges:evaluation: Waiting for Gym to activate... 15:13:39 evaluator INFO:duckietown-challenges:evaluation: Preparation done. 15:13:39 evaluator DEBUG:duckietown-challenges:Written to: /challenge-description/description.yaml 15:13:39 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (0 secs passed, will wait 600 secs more) 15:13:39 evaluator launch.sh > Starting xvfb 15:13:39 evaluator launch.sh > Started xvfb with PID 27 15:13:39 evaluator launch.sh > Now running gym_simulation_launcher.py 15:13:39 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 15:13:39 evaluator INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 15:13:39 evaluator INFO:gym-duckietown:gym-duckietown 2018.10.1 15:13:39 evaluator 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-straight_road-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-zigzag_dists-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_pedestrians-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-test_loop_obstacles-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_empty-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_dyn_duckiebots-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-udem1-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop_cw-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-4way-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop-v0 15:13:39 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_obstacles-v0 15:13:39 evaluator WARNING:rosout:Failed to load Python extension for LZ4 support. LZ4 compression will not be available. 15:13:39 evaluator launcher|gym_simulation_launcher.py:48 - main | launcher parameters: 15:13:39 evaluator 15:13:39 evaluator { 15:13:39 evaluator "challenge": "LF", 15:13:39 evaluator "episodes": 5, 15:13:39 evaluator "steps_per_episode": 500, 15:13:39 evaluator "environment-constructor": "Simulator", 15:13:39 evaluator "include_map": true, 15:13:39 evaluator "environment-parameters": { 15:13:39 evaluator "seed": 123, 15:13:39 evaluator "map_name": "loop_empty", 15:13:39 evaluator "max_steps": 500001, 15:13:39 evaluator "domain_rand": 0, 15:13:39 evaluator "camera_width": 640, 15:13:39 evaluator "camera_height": 480, 15:13:39 evaluator "accept_start_angle_deg": 4, 15:13:39 evaluator "full_transparency": true, 15:13:39 evaluator "distortion": true 15:13:39 evaluator }, 15:13:39 evaluator "agent-info": { 15:13:39 evaluator "challenge": "LF" 15:13:39 evaluator } 15:13:39 evaluator } 15:13:39 evaluator launcher|gym_simulation_launcher.py:59 - main | using gym-duckietown version 2018.10.1 15:13:40 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 15:13:40 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 15:13:40 evaluator gym-duckietown| simulator.py:490 - _load_map | loading map file "/workspace/gym-duckietown/gym_duckietown/maps/loop_empty.yaml" 15:13:40 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.obj" 15:13:40 evaluator gym-duckietown| objmesh.py:238 - _load_mtl | loading materials from "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.mtl" 15:13:40 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckie.obj" 15:13:40 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/duckie.png" 15:13:40 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/cone.obj" 15:13:41 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/cone.png" 15:13:41 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/floor_1.png" 15:13:41 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_left_1.png" 15:13:41 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/straight_1.png" 15:13:41 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_right_1.png" 15:13:41 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [4.05833625 0. 2.17835003] 1.62929007381 15:13:43 evaluator launcher|gym_simulation_launcher.py:74 - main | Logging gym state to: /tmp/tmplyL5wl/episodes 15:13:43 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [2.75442323 0. 3.0079666 ] 4.83604950287 15:13:43 evaluator launcher|gym_simulation_launcher.py:89 - main | Simulator listening to incoming connections... 15:13:43 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep000 15:13:43 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:13:43 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:13:43 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.57449761 0. 1.00806868] 0.0328325810557 15:13:44 evaluator launcher|gym_simulation_launcher.py:237 - run_episode | received ping: {u'topic': 1, u'ip': u'172.18.0.3', u'id': u'20104', u'msg': u'0'} 15:13:44 evaluator launcher|gym_simulation_launcher.py:240 - run_episode | received 2, resetting: {u'topic': 2, u'ip': u'172.18.0.3', u'id': u'20104', u'msg': u'0'} 15:13:44 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.9473256 0. 2.19364627] 4.70207132071 15:13:45 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.695, done=False 15:13:46 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.624, done=False 15:13:47 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-1.245, done=False 15:13:48 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.949, done=False 15:13:49 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (10 secs passed, will 15:13:39 solution INFO:gym-duckietown-agent:gym-duckietown-agent 2018.10.1 15:13:39 solution INFO:duckietown-challenges:duckietown-challenges 3.2.13 15:13:40 solution INFO:duckietown-challenges:solution:Parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 15:13:40 solution INFO:duckietown-challenges:solution:Starting. 15:13:40 solution INFO:duckietown-challenges:solution:Creating model. 15:13:40 solution INFO:duckietown-challenges:solution:Making environment 15:13:40 solution INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 15:13:40 solution INFO:duckietown-challenges:solution:Reset environment 15:13:44 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 15:14:03 solution Starting submission 15:14:03 solution (u'starting sub socket on', 8902) 15:14:03 solution [[-6949.509 -2805.532 -6481.555 -5825.258 -4227.846]] 15:14:03 solution [[-2543.11 -1205.795 -1968.444 -2501.926 -1599.766]] 15:14:03 solution [[-120.437 -259.064 -94. -200.718 -321.797]] 15:14:03 solution [[ -45.93 -191.612 -40.516 -46.306 -233.052]] 15:14:03 solution [[ -34.417 -166.198 -26.463 -31.838 -200.427]] 15:14:03 solution [[ -19.125 -138.84 -20.324 -24.873 -167.067]] 15:14:03 solution [[ -10.434 -135.554 -13.016 -21.274 -162.791]] 15:14:03 solution [[ -26.753 -160.548 -21.13 -33.598 -193.876]] 15:14:03 solution [[ -40.298 -211.519 -28.389 -41.924 -258.911]] 15:14:03 solution [[ -26.814 -203.911 -18.323 -30.937 -249.029]] 15:14:03 solution [[ -22.686 -212.631 -9.472 -18.827 -259.439]] 15:14:03 solution [[ -17.586 -209.009 -15.668 -21.244 -255.849]] 15:14:03 solution [[ -13.225 -193.719 -5.324 -18.183 -236.375]] 15:14:03 solution [[ -16.873 -195.883 -2.396 -14.293 -237.62 ]] 15:14:03 solution [[ -9.561 -178.939 -4.404 -14. -217.662]] 15:14:03 solution [[ -13.273 -168.157 -5.839 -22.716 -203.418]] 15:14:03 solution [[ -8.754 -160.535 -6.347 -20.389 -193.384]] 15:14:03 solution [[ -10.456 -157.811 -2.749 -16.979 -186.844]] 15:14:03 solution [[ -7.341 -131.538 2.966 -11.811 -155.731]] 15:14:03 solution [[ 4.881 -104.106 9.935 3.248 -120.515]] 15:14:03 solution [[ 9.252 -87.785 5.379 7.991 -104.684]] 15:14:03 solution [[ 8.277 -95.467 -2.842 4.86 -117.847]] 15:14:03 solution [[ 0.898 -91.182 6.693 -3.411 -106.637]] 15:14:03 solution [[-2.09510e+01 -1.44534e+02 1.00000e-01 -1.43720e+01 -1.73162e+02]] 15:14:03 solution [[ -10.58 -109.665 3.84 -8.335 -131.651]] 15:14:03 solution [[ 5.572 -67.889 5.705 4.993 -82.541]] 15:14:03 solution [[ 10.547 -63.234 1.461 7.193 -81.093]] 15:14:03 solution [[ 2.39 -91.569 -30.591 -22.704 -121.747]] 15:14:03 solution [[ 2.498 -63.353 -0.32 1.563 -80.023]] 15:14:03 solution [[ -11.997 -110.801 2.955 -2.683 -132.286]] 15:14:03 solution [[ -27.913 -179.145 -8.447 -14.495 -219.753]] 15:14:03 solution [[ -23.798 -139.59 -5.87 -9.704 -171.44 ]] 15:14:03 solution [[ -0.364 -80.74 3.265 1.271 -103.284]] 15:14:03 solution [[ 5.842 -67.446 0.308 4.834 -88.941]] 15:14:03 solution [[ 4.157 -90.399 -14.457 -1.423 -121.682]] 15:14:03 solution [[ 4.609 -76.671 4.569 5.788 -99.779]] 15:14:03 solution [[ -6.571 -140.656 2.839 3.044 -181.839]] 15:14:03 solution [[ -12.532 -130. -2.419 -1.029 -168.838]] 15:14:03 solution [[ -4.739 -117.022 -5.059 -2.403 -151.865]] 15:14:03 solution [[ -5.342 -115.51 -9.815 -5.474 -149.603]] 15:14:03 solution [[ -12.795 -118.571 -15.441 -11.995 -149.694]] 15:14:03 solution [[ -18.415 -163.878 -20.179 -16.088 -207.303]] 15:14:03 solution [[ -24.115 -141.405 -17.781 -19.26 -173.243]] 15:14:03 solution [[ -25.762 -134.459 -27.671 -26.528 -164.912]] 15:14:03 solution [[ -24.713 -167.48 -50.519 -37.026 -204.161]] 15:14:03 solution [[ -27.365 -172.754 -33.396 -30.29 -210.756]] 15:14:03 solution [[ -26.329 -175.044 -32.009 -27.639 -219.586]] 15:14:03 solution [[ -19.786 -165.593 -22.867 -19.551 -209.316wait 590 secs more) 15:13:49 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.626, done=False 15:13:50 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.57, done=False 15:13:51 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.608, done=False 15:13:52 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.075, done=False 15:13:53 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.282, done=False 15:13:54 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.562, done=False 15:13:55 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.71, done=False 15:13:56 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-1.006, done=False 15:13:56 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-1.284, done=False 15:13:57 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-1.765, done=False 15:13:58 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-2.022, done=False 15:13:59 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (20 secs passed, will wait 580 secs more) 15:13:59 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-1.582, done=False 15:14:00 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-1.824, done=False 15:14:01 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-1.426, done=False 15:14:02 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.982, done=False 15:14:03 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.66, done=False 15:14:04 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:14:04 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep000 15:14:04 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:14:04 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep001 15:14:04 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:14:04 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:14:04 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.94220351 0. 1.23114947] 4.68721314392 15:14:05 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.628, done=False 15:14:06 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.608, done=False 15:14:07 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.697, done=False 15:14:07 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.675, done=False 15:14:08 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.702, done=False 15:14:09 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (30 secs passed, will wait 570 secs more) 15:14:09 evaluator]] 15:14:03 solution [[ -20.888 -159.617 -24.946 -20.958 -205.059]] 15:14:03 solution [[ -15.918 -153.755 -29.14 -21.474 -198.705]] 15:14:03 solution [[ -14.627 -139.249 -26.322 -19.09 -180.512]] 15:14:03 solution [[ -23.226 -140.878 -32.695 -26.982 -179.63 ]] 15:14:03 solution [[ -24.567 -117.285 -29.864 -27.73 -147.932]] 15:14:03 solution [[ -26.128 -120.642 -33.931 -29.964 -151.316]] 15:14:03 solution [[ -19.559 -124.657 -22.193 -19.434 -157.288]] 15:14:03 solution [[ -15.855 -136.242 -20.251 -16.053 -171.863]] 15:14:03 solution [[ -13.109 -115.612 -26.68 -19.519 -145.796]] 15:14:03 solution [[ -12.776 -149.633 -26.458 -18.1 -187.425]] 15:14:03 solution [[ -16.778 -166.478 -8.588 -9.392 -207.488]] 15:14:03 solution [[ -28.141 -182.799 -10.163 -14.969 -226.677]] 15:14:03 solution [[ -3.531 -152.751 -4.115 -1.829 -189.088]] 15:14:03 solution [[ -2.187 -157.782 -29.016 -17.628 -190.491]] 15:14:03 solution [[ -10.946 -190.622 -51.366 -43.063 -230.651]] 15:14:03 solution [[ 5.028 -155.458 -2.752 3.121 -183.316]] 15:14:03 solution [[ -15.549 -148.891 -8.807 -15.05 -172.967]] 15:14:03 solution [[ -24.804 -183.62 -23.214 -26.712 -220.228]] 15:14:03 solution [[ -6.34 -157.788 -4.429 -8.077 -185.96 ]] 15:14:03 solution [[ -0.596 -142.62 4.981 -1.13 -166.329]] 15:14:03 solution [[ 9.609 -145.815 11.566 10.431 -167.811]] 15:14:03 solution [[ 8.054 -160.097 4.629 6.114 -185.556]] 15:14:03 solution [[ 7.081 -165.636 -2.504 1.103 -197.531]] 15:14:03 solution [[ -5.416 -148.642 -3.648 -17.819 -171.937]] 15:14:03 solution [[ -2.279 -162.048 3.884 -4.502 -190.532]] 15:14:03 solution [[ -8.337 -163.648 -8.151 -19.453 -191.005]] 15:14:03 solution [[ -4.401 -153.59 2.589 -15.007 -180.569]] 15:14:03 solution [[ 9.152 -142.313 15.422 10.157 -163.264]] 15:14:03 solution [[ 15.579 -115.985 14.599 15.96 -134.063]] 15:14:03 solution [[ 13.17 -108.435 2.532 8.565 -131.01 ]] 15:14:03 solution [[ 9.659 -108.4 1.258 7.453 -130.708]] 15:14:03 solution [[ 4.418 -117.15 13.583 0.468 -135.116]] 15:14:03 solution [[ -19.892 -183.07 6.565 -7.959 -217.408]] 15:14:03 solution [[ -7.474 -144.09 9.93 -2.804 -170.739]] 15:14:23 solution [[ 7.537 -81.901 12.905 8.973 -95.94 ]] 15:14:23 solution [[ 12.547 -63.008 9.477 11.693 -77.22 ]] 15:14:23 solution [[ 11.193 -74.863 -6.112 1.44 -95.801]] 15:14:23 solution [[ -3.55 -85.325 6.289 2.832 -107.691]] 15:14:23 solution [[-2.06280e+01 -1.67905e+02 8.10000e-02 -5.99000e-01 -2.12606e+02]] 15:14:23 solution [[ 1.32000e-01 -1.11143e+02 4.12700e+00 5.13400e+00 -1.43638e+02]] 15:14:23 solution [[ 8.231 -81.607 -6.682 3.304 -108.6 ]] 15:14:23 solution [[ 1.125 -104.489 -18.844 -4.787 -138.169]] 15:14:23 solution [[ 0.906 -80.408 3.933 3.898 -102.623]] 15:14:23 solution [[ -1.254 -125.567 3.946 5.991 -162.311]] 15:14:23 solution [[ 8.946 -105.198 1.028 7.1 -138.188]] 15:14:23 solution [[ 7.997 -102.13 -7.987 3.268 -135.289]] 15:14:23 solution [[ 1.848 -109.539 2.534 4.709 -141.004]] 15:14:23 solution [[ -13.842 -174.488 -1.346 0.961 -221.1 ]] 15:14:23 solution [[ -4.555 -140.594 -2.163 -0.197 -179.115]] 15:14:23 solution [[ -1.047 -111.336 2.787 2.394 -142.513]] 15:14:23 solution [[-2.90000e-02 -1.03696e+02 6.12000e-01 2.23800e+00 -1.32873e+02]] 15:14:23 solution [[ -2.858 -118.067 -28.446 -12.686 -154.091]] 15:14:23 solution [[ -7.667 -141.836 -35.669 -19.571 -179.877]] 15:14:23 solution [[ -6.24 -109.428 -14.027 -7.153 -140.49 ]] 15:14:23 solution [[ -10.417 -117.486 -5.859 -5.913 -147.398]] 15:14:23 solution [[ -31.699 -196.581 -9.648 -8.018 -246.062]] 15:14:23 solution [[ -13.426 -135.015 -3.832 -3.529 -171.527]] 15:14:23 solution [[ -4.032 -128.324 -2.718 1.108 -165.04 ]] 15:14:23 solution [[ -0.297 -130.283 -12.614 -2.331 -169.497]] 15:14:23 solution [[ -1.947 -111.888 -21.643 -7.322 -146.974]] 15:14:23 solution [[ -16.12 launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.661, done=False 15:14:10 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.716, done=False 15:14:11 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.626, done=False 15:14:12 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.397, done=False 15:14:13 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.922, done=False 15:14:14 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.585, done=False 15:14:15 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.467, done=False 15:14:16 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.427, done=False 15:14:17 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=0.167, done=False 15:14:18 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.02, done=False 15:14:19 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.239, done=False 15:14:19 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (40 secs passed, will wait 560 secs more) 15:14:20 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.508, done=False 15:14:20 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.631, done=False 15:14:21 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.78, done=False 15:14:22 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-1.012, done=False 15:14:23 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:14:23 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep001 15:14:23 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:14:23 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep002 15:14:23 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:14:23 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:14:23 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [0.84497723 0. 1.12248482] 4.62469817798 15:14:24 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-0.095, done=False 15:14:25 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-0.229, done=False 15:14:26 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-0.348, done=False 15:14:27 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.418, done=False 15:14:28 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.454, done=False 15:14:29 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (50 secs passed, will wait 550 secs more) 15:14:29 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.56, done=False 15:14:30 evaluator launcher|gym_simulation_launcher.py -150.073 -8.368 -4.791 -188.927]] 15:14:23 solution [[ -34.779 -215.396 -24.194 -22.432 -270.715]] 15:14:23 solution [[ -22.972 -187.331 -6.318 -5.766 -229.929]] 15:14:23 solution [[ -25.077 -200.27 -7.355 -6.757 -244.627]] 15:14:23 solution [[ -41.42 -207.456 -19.767 -43.576 -250.34 ]] 15:14:23 solution [[ -7.069 -196.231 -21.405 -12.414 -234.285]] 15:14:23 solution [[ -11.886 -219.554 -48.608 -41.795 -260.375]] 15:14:23 solution [[ -32.677 -190.774 -17.478 -26.943 -222.815]] 15:14:23 solution [[ -67.105 -205.212 -38.415 -60.457 -239.794]] 15:14:23 solution [[ -29.56 -189.06 -16.38 -22.497 -222.305]] 15:14:23 solution [[ -8.742 -190.065 -9.956 -8.077 -220.931]] 15:14:23 solution [[ -5.511 -193.028 -7.992 -11.578 -226.057]] 15:14:23 solution [[ -24.826 -213.815 -19.024 -38.423 -252.625]] 15:14:23 solution [[ -19.998 -224.774 -1.61 -24.16 -264.123]] 15:14:23 solution [[ -16.749 -229.443 0.974 -19.286 -268.975]] 15:14:23 solution [[ -19.134 -223.979 -5.263 -22.843 -263.097]] 15:14:23 solution [[ -22.135 -206.962 -8.643 -27.825 -244.371]] 15:14:23 solution [[ -21.524 -202.952 -16.364 -26.049 -239.89 ]] 15:14:23 solution [[ -24.651 -186.637 -22.009 -40.278 -223.576]] 15:14:23 solution [[ -22.897 -173.182 -5.994 -23.637 -205.988]] 15:14:23 solution [[ -15.713 -158.132 -4.85 -16.225 -188.756]] 15:14:23 solution [[ 4.659 -125.652 4.891 0.455 -149.102]] 15:14:23 solution [[ 5.386 -112.481 -1.056 3.677 -134.69 ]] 15:14:23 solution [[ 6.226 -111.177 -6.296 2.61 -137.29 ]] 15:14:23 solution [[ -7.114 -114.46 2.272 -13.193 -134.644]] 15:14:23 solution [[ -28.326 -152.873 -7.206 -29.843 -183.447]] 15:14:23 solution [[-1.65860e+01 -1.17409e+02 -9.50000e-02 -1.98620e+01 -1.40922e+02]] 15:14:23 solution [[ 4.902 -80.294 3.769 3.9 -96.348]] 15:14:23 solution [[ 7.309 -64.126 2.026 5.363 -80.728]] 15:14:23 solution [[ -8.708 -102.129 1.583 -2.881 -122.158]] 15:14:23 solution [[ -36.23 -165.392 -14.733 -32.238 -201.355]] 15:14:23 solution [[ -17.091 -120.643 -0.607 -5.381 -147.59 ]] 15:14:23 solution [[ 1.278 -66.576 3.105 2.045 -85.316]] 15:14:23 solution [[ 10.927 -56.811 3.957 9.059 -76.834]] 15:14:23 solution [[ 2.542 -85.782 -21.123 -9.786 -116.936]] 15:14:23 solution [[ 4.097 -74.548 2.52 4.535 -96.822]] 15:14:23 solution [[ -12.906 -119.71 0.914 -1.922 -152.072]] 15:14:23 solution [[ 0.21 -115.978 8.277 5.931 -151.318]] 15:14:23 solution [[ 8.351 -71.39 4.011 6.987 -94.401]] 15:14:23 solution [[ 3.854 -82.523 -10.198 -0.438 -109.56 ]] 15:14:23 solution [[ 2.02 -101.125 3.06 5.469 -132.148]] 15:14:23 solution [[ 5.923 -154.669 8.874 3.911 -207.221]] 15:14:23 solution [[ -12.262 -150.886 -5.027 -2.793 -197.004]] 15:14:23 solution [[ -5.79 -128.783 -6.816 -2.627 -166.536]] 15:14:23 solution [[ -9.293 -139.903 -15.647 -9.835 -176.247]] 15:14:23 solution [[ -12.099 -158.111 -22.043 -15.268 -191.65 ]] 15:14:23 solution [[ -12.44 -142.854 -8.371 -8.64 -174.096]] 15:14:23 solution [[ -19.056 -171.176 -13.03 -12.66 -218.021]] 15:14:23 solution [[ -14.181 -146.133 -14.881 -13.46 -180.169]] 15:14:23 solution [[ -23.757 -164.584 -48.465 -35.335 -203.197]] 15:14:23 solution [[ -44.707 -201.931 -74.867 -65.783 -248.404]] 15:14:23 solution [[ -33.611 -202.815 -63.763 -51.948 -252.093]] 15:14:23 solution [[ -27.072 -181.978 -57.011 -48.504 -229.092]] 15:14:23 solution [[ -20.272 -167.126 -48.293 -32.589 -213.778]] 15:14:23 solution [[ -12.007 -161.423 -32.004 -20.157 -209.624]] 15:14:23 solution [[ -11.347 -137.71 -22.044 -14.893 -177.751]] 15:14:23 solution [[ -13.475 -123.948 -22.596 -17.006 -158.988]] 15:14:42 solution [[ -17.612 -124.253 -29.368 -22.367 -158.48 ]] 15:14:42 solution [[ -16.041 -127.314 -25.557 -18.282 -162.998]] 15:14:42 solution [[ -11.879 -133.938 -17.497 -11.59 -169.972]] 15:14:42 solution [[ -38.553 -185.966 -82.108 -75.45 -240.872]] 15:14:42 solution [[ -48.132 -201.584 -79.527 -80.403 -259.156]] 15:14:42 solution [[ -22.144 -156.837 -65.463 -62.6 -197.134]] 15:14:42 solution [[ 3.51 -105.423 -25.319 -19.563 -131.255]] 15:14:42 solution [[ 7.006 -76.025 11.347 9.123 -88.786]] 15:14:42 solution [[ -3.513 -108.967 11.095 3.57 -127.24 ]] 15:14:42 solution [[ 9.228 -74.661 12.736 11.344 -90.87 ]] 15:14:42 solution [[ 7.285 -89.048 -15.711 -5.1 -116.397]] 15:14:42 solution [[ 3.539 -124.421 -33.264 -21.08 -156.735]] 15:14:42 solution [[ 6.849 -64.533 1.779 4.935 -80.859]] 15:14:42 solution [[ -1.549 -101.673 5.776 1.421 -120.066]] 15:14:42 solution [[ -22.611 -163.053 6.03 -2.542 -194.966]] 15:14:42 solution [[ -0.143 -78.662 9.642 3.163 -94.989]] 15:14:42 solution [[ 4.0260e+00 -6.2527e+01 1.1000e-02 2.9330e+00 -8.1368e+01]] 15:14:42 solution [[ 7.614 -75.414 -13.273 -0.323 -100.808]] 15:14:42 solution [[ -1.02 -58.926 4.515 1.012 -72.384]] 15:14:42 solution [[ -3.968 -97.873 3.253 -0.808 -119.31 ]] 15:14:42 solution [[ 1.834 -69.364 0.651 2.343 -89.191]] 15:14:42 solution [[ -1.908 -98.973 -27.386 -12.137 -130.576]] 15:14:42 solution [[ 1.954 -125.119 -26.659 -13.164 -160.384]] 15:14:42 solution [[ 2.848 -74.681 -2.947 1.993 -96.977]] 15:14:42 solution [[ 1.052 -95.295 6.227 4.41 -114.828]] 15:14:42 solution [[ -16.234 -165.254 5.295 1.149 -200.669]] 15:14:42 solution [[ 3.562 -89.047 9.68 6.926 -111.021]] 15:14:42 solution [[ 6.764 -69.055 -1.4 4.611 -91.116]] 15:14:42 solution [[ 1.738 -107.825 -19.802 -5.998 -140.424]] 15:14:42 solution [[-2.03500e+00 -8.60250e+01 -1.43700e+00 4.00000e-03 -1.09442e+02]] 15:14:42 solution [[ -5.719 -112.013 -0.402 -2.149 -138.877]] 15:14:42 solution [[ -0.947 -92.401 6.043 3.335 -117.632]] 15:14:42 solution [[ 6.555 -78.59 -4.223 3.277 -103.768]] 15:14:42 solution [[ -1.257 -128.457 -26.958 -11.932 -163.353]] 15:14:42 solution [[ -7.043 -103.656 -7.579 -5.266 -131.5 ]] 15:14:42 solution [[ -9.285 -106.735 -1.307 -4.49 -133.389]] 15:14:42 solution [[ -5.165 -103.971 0.506 -1.288 -131.512]] 15:14:42 solution [[ -0.519 -110.333 -24.674 -10.258 -144.864]] 15:14:42 solution [[ -7.112 -157.936 -41.54 -26.213 -202.566]] 15:14:42 solution [[ -6.546 -108.09 -24.8 -14.213 -136.649]] 15:14:42 solution [[-9.44400e+00 -1.03717e+02 -7.40000e-02 -4.30900e+00 -1.28057e+02]] 15:14:42 solution [[ -26.953 -167.101 -7.888 -11.464 -206.795]] 15:14:42 solution [[ -8.58 -102.335 -0.897 -4.855 -128.984]] 15:14:42 solution [[ -5.733 -120.773 -34.928 -18.107 -156.056]] 15:14:42 solution [[ -4.786 -151.882 -35.627 -18.752 -194. ]] 15:14:42 solution [[ -8.251 -98.266 -23.455 -15.111 -125.147]] 15:14:42 solution [[ -9.119 -108.926 -1.406 -5.088 -135.782]] 15:14:42 solution [[ -22.252 -165.896 -8.496 -10.653 -206.37 ]] 15:14:42 solution [[ -6.244 -107.466 2.03 -1.985 -135.437]] 15:14:42 solution [[ -6.347 -111.663 -29.006 -15.877 -145.053]] 15:14:42 solution [[ -12.556 -170.491 -41.879 -26.845 -216.227]] 15:14:42 solution [[ -6.374 -116.479 -31.819 -17.926 -148.783]] 15:14:42 solution [[ -6.059 -109.272 0.921 -1.387 -135.624]] 15:14:42 solution [[ -17.398 -147.586 -7.911 -8.49 -182.796]] 15:14:42 solution [[ -1.283 -112.251 1.258 1.257 -143.205]] 15:14:42 solution [[ -8.471 -141.466 -38.906 -20.644 -182.79 ]] 15:14:42 solution [[ -8.065 -175.321 -40.365 -23.88 -223.425]] 15:14:42 solution [[ -5.782 -117.809 -26.378 -14.353 -148.761]] 15:14:42 solution [[ -7.772 -114.718 -1.364 -2.985 -144.159]] 15:14:42 solution [[ -18.399 -162.796 -9.071 -10.115 -205.636]] 15:14:42 solution [[ -5.068 -111.581 -0.296 -1.664 -141.684]] 15:14:42 solution [[ -12.431 -156.471 -43.853 -24.865 -201.203]] 15:14:42 solution [[ -11.856 -185.74 -44.876 -26.495 -234.224]] 15:14:42 solution [[ -9.245 -121.655 -29.404 -17.531 -152.956]] 15:14:42 solution [[ -13.091 -120.533 -1.512 -4.81 -151.197]] 15:14:42 solution [[ -26.859 -183.208 -:231 - run_episode | step_count=168, reward=-0.625, done=False 15:14:31 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-0.651, done=False 15:14:32 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.675, done=False 15:14:33 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.708, done=False 15:14:34 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.684, done=False 15:14:34 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.688, done=False 15:14:35 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-0.72, done=False 15:14:36 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.696, done=False 15:14:37 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.7, done=False 15:14:38 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.733, done=False 15:14:39 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (60 secs passed, will wait 540 secs more) 15:14:39 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.708, done=False 15:14:40 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.712, done=False 15:14:41 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.745, done=False 15:14:42 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.721, done=False 15:14:43 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:14:43 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep002 15:14:43 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:14:43 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep003 15:14:43 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:14:43 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:14:43 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.00329777 0. 0.86708317] 0.0349480490083 15:14:44 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-1.383, done=False 15:14:45 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-1.289, done=False 15:14:46 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-1.075, done=False 15:14:47 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-0.969, done=False 15:14:48 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-0.847, done=False 15:14:49 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-0.791, done=False 15:14:49 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (70 secs passed, will wait 530 secs more) 15:14:50 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-0.667, done=False 15:14:51 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count9.659 -10.684 -233.522]] 15:14:42 solution [[ -6.425 -118.742 -1.927 -3.325 -151.302]] 15:14:42 solution [[ -10.518 -132.207 -37.92 -21.253 -171.312]] 15:14:42 solution [[ -13.795 -184.317 -45.9 -29.285 -231.082]] 15:14:42 solution [[ -14.437 -131.544 -33.29 -21.865 -164.191]] 15:14:42 solution [[ -21.764 -121.757 -4.303 -9.171 -151.757]] 15:14:42 solution [[ -39.933 -186.537 -10.964 -15.093 -237.504]] 15:14:42 solution [[ -9.055 -128.722 -1.329 -2.697 -165.012]] 15:14:42 solution [[ -13.014 -129.542 -39.998 -24.009 -166.637]] 15:14:42 solution [[ -11.218 -186.128 -46.349 -28.819 -232.091]] 15:14:42 solution [[ -18.29 -140.392 -28.691 -21.199 -174.671]] 15:14:42 solution [[ -30.429 -143.667 -12.646 -16.033 -178.753]] 15:14:42 solution [[ -53.947 -207.078 -34.662 -41.082 -264.986]] 15:14:42 solution [[ -30.101 -139.916 -12.343 -16.604 -175.182]] 15:14:42 solution [[ -14.494 -166.615 -33.77 -21.225 -209.415]] 15:14:42 solution [[ -9.604 -206.485 -38.887 -21.58 -252.673]] 15:14:42 solution [[ -15.287 -171.342 -25.222 -18.229 -209.532]] 15:14:42 solution [[ -30.156 -166.588 -9.148 -13.591 -204.011]] 15:15:02 solution [[ -63.846 -238.462 -34.52 -47.473 -299.78 ]] 15:15:02 solution [[ -20.632 -178.863 -7.169 -10.029 -216.283]] 15:15:02 solution [[ -23.703 -187.187 -44.007 -34.369 -228.526]] 15:15:02 solution [[-118.723 -238.019 -138.996 -223.569 -299.924]] 15:15:02 solution [[ -33.36 -219.377 -23.656 -46.685 -292.374]] 15:15:02 solution [[ -64.577 -238.343 -60.958 -78.599 -316.405]] 15:15:02 solution [[ -62.576 -253.851 -47.692 -122.342 -352.481]] 15:15:02 solution [[ -33.193 -244.354 -31.454 -114.831 -342.851]] 15:15:02 solution [[ 16.192 -187.161 17.258 4.102 -256.597]] 15:15:02 solution [[ 12.139 -134.775 3.596 6.588 -179.874]] 15:15:02 solution [[ 2.353 -105.124 -13.413 -3.305 -138.336]] 15:15:02 solution [[ -1.106 -137.074 0.379 4.995 -179.46 ]] 15:15:02 solution [[ 7.266 -167.514 11.177 6.769 -224.472]] 15:15:02 solution [[-4.62300e+00 -1.47209e+02 3.80000e-02 5.32100e+00 -1.91806e+02]] 15:15:02 solution [[ -7.193 -117.679 -27.341 -15.061 -153.406]] 15:15:02 solution [[ -7.298 -153.177 -32.407 -15.65 -194.412]] 15:15:02 solution [[ -11.78 -152.821 -27.276 -18.819 -193.616]] 15:15:02 solution [[ -27.253 -170.491 -13.515 -16.682 -215.315]] 15:15:02 solution [[ -57.586 -214.418 -38.563 -51.975 -276.661]] 15:15:02 solution [[ -29.953 -184.129 -9.843 -14.871 -232.895]] 15:15:02 solution [[ -11.068 -182.296 -32.537 -21.065 -224.356]] 15:15:02 solution [[ -2.008 -199.827 -24.942 -12.691 -242.053]] 15:15:02 solution [[ -20.162 -193.44 -32.258 -32.204 -233.129]] 15:15:02 solution [[ -40.381 -186.821 -24.098 -29.88 -227.57 ]] 15:15:02 solution [[ -50.698 -191.656 -25.734 -37.565 -238.749]] 15:15:02 solution [[ -27.609 -164.602 -11.618 -20.88 -202.332]] 15:15:02 solution [[ -6.066 -173.647 -22.126 -15.484 -210.265]] 15:15:02 solution [[ -2.989 -187.658 -26.629 -20.809 -224.307]] 15:15:02 solution [[ -23.36 -170.773 -15.378 -21.36 -203.394]] 15:15:02 solution [[ -41.543 -171.005 -23.76 -34.689 -204.437]] 15:15:02 solution [[ -35.015 -167.477 -22.917 -40.915 -201.159]] 15:15:02 solution [[ -30.708 -175.97 -18.116 -40.139 -210.384]] 15:15:02 solution [[ -24.683 -188.877 -16.558 -34.042 -225.112]] 15:15:02 solution [[ -34.368 -212.928 -23.028 -40.699 -255.253]] 15:15:02 solution [[ -28.916 -214.048 -28.82 -44.255 -255.99 ]] 15:15:02 solution [[ -47.159 -226.033 -45.334 -69.352 -276.222]] 15:15:02 solution [[ -45.467 -249.539 -48.068 -62.438 -308.199]] 15:15:02 solution [[ -23.638 -239.647 -24.345 -32.3 -293.88 ]] 15:15:02 solution [[ -49.294 -227.644 -28.72 -54.095 -272.798]] 15:15:02 solution [[ -53.134 -227.633 -43.29 -67.202 -269.846]] 15:15:02 solution [[ -63.959 -226.757 -34.983 -71.618 -269.096]] 15:15:02 solution [[ -62.146 -228.535 -35.223 -56.324 -270.483]] 15:15:02 solution [[ -35.883 -211.953 1.028 -30.373 -250.501]] 15:15:02 solution [[ -7.506 -=192, reward=-0.419, done=False 15:14:51 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-0.653, done=False 15:14:52 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-0.402, done=False 15:14:53 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-0.653, done=False 15:14:54 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-0.503, done=False 15:14:55 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=0.254, done=False 15:14:56 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.086, done=False 15:14:57 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.185, done=False 15:14:58 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=-0.329, done=False 15:14:59 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (80 secs passed, will wait 520 secs more) 15:14:59 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.419, done=False 15:15:00 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.457, done=False 15:15:01 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.521, done=False 15:15:02 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.584, done=False 15:15:03 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:15:03 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep003 15:15:03 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:15:03 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep004 15:15:03 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 15:15:03 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 15:15:03 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [1.72410152 0. 3.21929481] 0.0317184229532 15:15:04 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=24, reward=-2.144, done=False 15:15:04 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=48, reward=-2.247, done=False 15:15:05 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=72, reward=-2.315, done=False 15:15:06 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=96, reward=-2.332, done=False 15:15:07 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=120, reward=-2.385, done=False 15:15:08 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=144, reward=-2.423, done=False 15:15:09 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (90 secs passed, will wait 510 secs more) 15:15:09 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=168, reward=-2.527, done=False 15:15:10 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=192, reward=-2.696, done=False 15:15:11 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=216, reward=-2.875, done=False 15188.91 5.185 -4.657 -225.078]] 15:15:02 solution [[ 10.842 -167.206 -5.167 1.615 -202.952]] 15:15:02 solution [[ 3.368 -165.69 -24.858 -23.479 -204.737]] 15:15:02 solution [[ -6.427 -170.629 6.069 -3.294 -202.663]] 15:15:02 solution [[ -49.583 -204.212 -9.381 -39.988 -242.365]] 15:15:02 solution [[ -21.643 -172.159 13.126 -10.53 -203.962]] 15:15:02 solution [[ 16.882 -128.912 12.42 16.356 -152.423]] 15:15:02 solution [[ 1.26980e+01 -1.26432e+02 -1.45000e-01 7.94000e+00 -1.54447e+02]] 15:15:02 solution [[ -0.696 -133.99 14.892 5.915 -157.417]] 15:15:02 solution [[ -66.492 -193.054 1.144 -46.461 -233.273]] 15:15:02 solution [[ -7.74 -143.127 18.307 8.235 -168.585]] 15:15:02 solution [[ 14.181 -92.812 14.098 15.185 -111.749]] 15:15:02 solution [[ 9.564 -95.427 -9.264 -0.84 -123.041]] 15:15:02 solution [[ 6.858 -96.08 -10.779 -0.778 -126.481]] 15:15:02 solution [[ 6.711 -98.019 8.53 8.795 -120.304]] 15:15:02 solution [[ -34.343 -176.736 1.385 -11.288 -213.104]] 15:15:02 solution [[ -22.093 -168.493 9.079 3.154 -206.425]] 15:15:02 solution [[ 4.241 -90.134 9.447 7.756 -113.55 ]] 15:15:02 solution [[ 7.452 -79.367 -5.741 3.718 -105.786]] 15:15:02 solution [[ 2.058 -120.385 -21.001 -5.625 -156.817]] 15:15:02 solution [[ 3.217 -86.997 -2.004 3.512 -112.997]] 15:15:02 solution [[ -4.213 -110.077 6.456 3.807 -134.999]] 15:15:02 solution [[ 4.096 -91.712 8.871 7.732 -116.393]] 15:15:02 solution [[ 5.55 -82.537 -9.058 1.018 -110.059]] 15:15:02 solution [[ 0.359 -119.942 -25.996 -13.609 -154.381]] 15:15:02 solution [[ 1.2000e-02 -8.7043e+01 -7.3270e+00 -9.0900e-01 -1.1287e+02]] 15:15:02 solution [[ -6.479 -103.831 0.969 -1.823 -127.553]] 15:15:02 solution [[ -34.748 -179.237 -0.408 -9.858 -219.788]] 15:15:02 solution [[ -7.511 -118.675 1.433 -0.181 -149.463]] 15:15:02 solution [[ 4.375 -82.505 -3.054 2.949 -107.85 ]] 15:15:02 solution [[ 0.946 -96.304 -20.331 -6.768 -127.755]] 15:15:02 solution [[ -2.467 -79.194 -2.351 -1.092 -100.946]] 15:15:02 solution [[ -17.14 -124.734 -5.688 -6.824 -156.541]] 15:15:02 solution [[ -5.406 -108.903 3.025 2.17 -138.913]] 15:15:02 solution [[ 5.662 -80.184 -4.952 3.021 -105.666]] 15:15:02 solution [[ -1.704 -111.168 -26.688 -11.138 -146.574]] 15:15:02 solution [[ -1.838 -96.315 -5.647 -1.128 -123.958]] 15:15:02 solution [[ -2.516 -117.876 1.722 3.103 -151.092]] 15:15:02 solution [[ -0.627 -116.23 1.916 4.911 -150.104]] 15:15:02 solution [[ 4.325 -99.091 -1.837 3.865 -129.052]] 15:15:21 solution [[ 0.389 -114.788 -11.492 -1.287 -149.344]] 15:15:21 solution [[ -11.798 -142.334 -5.444 -3.777 -180.609]] 15:15:21 solution [[ -54.645 -220.391 -29.379 -39.183 -279.446]] 15:15:21 solution [[ -36.196 -214.509 -8.771 -10.757 -270.998]] 15:15:21 solution [[ -66.349 -239.426 -80.416 -82.995 -312.289]] 15:15:21 solution [[ -40.006 -214.884 -44.404 -45.767 -283.682]] 15:15:21 solution [[ -60.715 -221.985 -68.485 -71.347 -289.361]] 15:15:21 solution [[ -45.33 -227.629 -48.764 -52.627 -285.554]] 15:15:21 solution [[ -66.257 -252.736 -27.911 -69.897 -295.216]] 15:15:21 solution [[-122.837 -288.033 -63.247 -190.768 -329.914]] 15:15:21 solution [[ -98.967 -271.393 -42.502 -131.547 -315.574]] 15:15:21 solution [[ -60.053 -229.99 -66.159 -70.236 -278.3 ]] 15:15:21 solution [[ -62.828 -220.614 -80.09 -72.731 -277.523]] 15:15:21 solution [[ -52.339 -239.282 -65.518 -56.566 -293.306]] 15:15:21 solution [[ -98.114 -269.524 -50.567 -129.165 -312.052]] 15:15:21 solution [[-157.826 -305.943 -93.515 -253.937 -352.132]] 15:15:21 solution [[-147.925 -311.302 -79.553 -249.023 -360.231]] 15:15:21 solution [[-110.518 -261.594 -95.454 -196.516 -311.55 ]] 15:15:21 solution [[-104.485 -229.912 -104.68 -147.45 -287.562]] 15:15:21 solution [[-103.607 -222.045 -111.973 -124.825 -286.091]] 15:15:21 solution [[ -77.583 -219.533 -93.376 -92.254 -280.561]] 15:15:21 solution [[ -66.595 -225.354 -80.479 -88.88 -273.151]] 15:15:21 solution [[-113.176 -247.508 -67.672 -172.185 -285.792]] 15:15:21 solution [[-154.601 -254.7 -76.873 -246.527 -291.702]] 15:15:21 solution [[-125.992 -264.435 -96.377 -213.73 -311.025]] 15:15:21 solution [[ -90.874 -243.516 -98.405 -153.813 -297.016]] 15:15:21 solution [[ -85.025 -245.4 -109.451 -112.118 -312.079]] 15:15:21 solution [[ -61.763 -251.479 -105.777 -96.101 -316.106]] 15:15:21 solution [[ -82.626 -253.912 -73.374 -98.975 -306.267]] 15:15:21 solution [[-108.537 -263.961 -83.101 -152.103 -315.574]] 15:15:21 solution [[ -72.936 -247.681 -86.835 -101.747 -305.713]] 15:15:21 solution [[ -71.362 -247.155 -108.475 -106.353 -316.391]] 15:15:21 solution [[ -64.989 -230.667 -84.354 -84.398 -293.509]] 15:15:21 solution [[ -75.964 -216.913 -75.635 -85.379 -276.598]] 15:15:21 solution [[ -70.649 -191.33 -50.72 -69.067 -246.544]] 15:15:21 solution [[ -38.076 -188.994 -28.355 -21.959 -242.505]] 15:15:21 solution [[ -9.74 -177.189 -20.948 -12.331 -230.418]] 15:15:21 solution [[ -20.944 -161.715 -45.597 -37.301 -209.534]] 15:15:21 solution [[ -21.441 -140.639 -25.803 -22.24 -180.271]] 15:15:21 solution [[ -27.32 -136.822 -30.605 -26.8 -173.629]] 15:15:21 solution [[ -17.768 -115.161 -24.872 -21.201 -146.634]] 15:15:21 solution [[ -18.395 -114.629 -26.612 -22.721 -143.626]] 15:15:21 solution [[ -20.834 -154.438 -51.726 -35.879 -191.648]] 15:15:21 solution [[ -20.045 -142.334 -51.115 -42.248 -174.709]] 15:15:21 solution [[ -4.342 -124.067 -24.673 -14.151 -154.279]] 15:15:21 solution [[ -7.835 -134.046 -20.169 -11.691 -168.676]] 15:15:21 solution [[-4.71800e+00 -1.32858e+02 9.42000e-01 1.62000e-01 -1.64417e+02]] 15:15:21 solution [[ -20.849 -178.906 -9.236 -9.303 -220.951]] 15:15:21 solution [[ 1.19 -131.923 0.89 3.323 -163.693]] 15:15:21 solution [[ 3.203 -146.618 -13.459 -8.671 -180.783]] 15:15:21 solution [[ 11.587 -146.132 0.964 5.549 -175.838]] 15:15:21 solution [[ -2.425 -152.871 3.511 2.074 -178.304]] 15:15:21 solution [[ -14.042 -175.742 -3.922 -6.677 -207.548]] 15:15:21 solution [[ 2.865 -145.491 5.725 3.373 -169.672]] 15:15:21 solution [[ 13.617 -133.468 17.639 14.833 -154.708]] 15:15:21 solution [[ 22.143 -116.915 24.907 24.167 -133.99 ]] 15:15:21 solution [[ 23.872 -114.283 12.376 17.054 -135.118]] 15:15:21 solution [[ 16.336 -131.254 -4.529 0.859 -158.493]] 15:15:21 solution [[ 25.257 -100.476 23.426 25.584 -115.152]] 15:15:21 solution [[ 16.857 -119.792 29.033 21.219 -134.808]] 15:15:21 solution [[ 13.961 -121.932 25.199 17.657 -139.658]] 15:15:21 solution [[ 17.085 -96.478 20.302 17.725 -109.858]] 15:15:21 solution [[ 19.198 -94.366 10.837 16.124 -112.649]] 15:15:21 solution [[ 11.08 -110.311 -19.06 -14.022 -138.727]] 15:15:21 solution [[ 13.462 -89.735 14.151 12.954 -101.653]] 15:15:21 solution [[ 2.3 -119.515 10.423 4.05 -138.623]] 15:15:21 solution [[ 4.7 -92.289 6.991 4.968 -109.911]] 15:15:21 solution [[ 10.306 -83.936 4.586 8.806 -104.846]] 15:15:21 solution [[ 4.997 -111.665 -24.474 -18.349 -143.068]] 15:15:21 solution [[ 4.078 -85.039 5.148 5.231 -103.548]] 15:15:21 solution [[ -14.308 -130.138 2.05 -6.163 -152.414]] 15:15:21 solution [[ -14.669 -121.519 -1.994 -8.973 -149.463]] 15:15:21 solution [[ -2.514 -78.912 2.817 0.283 -100.258]] 15:15:21 solution [[ -4.026 -106.087 -21.104 -10.035 -137.899]] 15:15:21 solution [[ -13.073 -150.072 -50.62 -41.976 -188.774]] 15:15:21 solution [[ -10.235 -84.467 -13.472 -10.236 -107.525]] 15:15:21 solution [[ -33.875 -120.549 -8.232 -15.911 -147.712]] 15:15:21 solution [[ -49.886 -190.029 -27.763 -33.82 -239.324]] 15:15:21 solution [[ -22.707 -113.004 -6.748 -12.93 -141.092]] 15:15:21 solution [[ -9.04 -78.311 -9.941 -8.654 -99.367]] 15:15:21 solution [[ -18.179 -148.605 -54.801 -43.241 -189.082]] 15:15:21 solution [[ -18.416 -172.873 -50.323 -45.521 -214.434]:15:12 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=240, reward=-3.111, done=False 15:15:13 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=264, reward=-2.511, done=False 15:15:14 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=288, reward=-1.702, done=False 15:15:15 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=312, reward=-1.239, done=False 15:15:16 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=336, reward=-0.589, done=False 15:15:17 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=360, reward=-0.005, done=False 15:15:18 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=384, reward=0.038, done=False 15:15:18 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=408, reward=-0.228, done=False 15:15:19 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (100 secs passed, will wait 500 secs more) 15:15:19 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=432, reward=-0.298, done=False 15:15:20 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=456, reward=-0.435, done=False 15:15:21 evaluator launcher|gym_simulation_launcher.py:231 - run_episode | step_count=480, reward=-0.454, done=False 15:15:22 evaluator launcher|gym_simulation_launcher.py:255 - run_episode | breaking because steps = 500 15:15:22 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep004 15:15:22 evaluator launcher|gym_simulation_launcher.py:119 - main | 500 steps are enough 15:15:22 evaluator starting pub socket on port 8902 15:15:22 evaluator launcher|gym_simulation_launcher.py:140 - main | Simulation done. 15:15:22 evaluator launcher|gym_simulation_launcher.py:152 - main | Clean exit. 15:15:22 evaluator launcher|gym_simulation_launcher.py:263 - <module> | success 15:15:22 evaluator launch.sh > gym_simulation_launcher terminated with return code 0 15:15:22 evaluator launch.sh > Killing xvfb... 15:15:22 evaluator launch.sh > Killed. 15:15:22 evaluator launch.sh > Graceful exit of launch.sh with return code 0 15:15:29 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (110 secs passed, will wait 490 secs more) 15:15:39 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (120 secs passed, will wait 480 secs more) 15:15:43 evaluator ERROR:duckietown-challenges:declare failed: 15:15:43 evaluator InvalidSubmission: 15:15:43 evaluator Traceback (most recent call last): 15:15:43 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator 15:15:43 evaluator raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION]) 15:15:43 evaluator InvalidSubmission: Invalid solution: 15:15:43 evaluator Traceback (most recent call last): 15:15:43 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution 15:15:43 evaluator raise InvalidSubmission(msg) 15:15:43 evaluator InvalidSubmission: Uncaught exception in solution: 15:15:43 evaluator Traceback (most recent call last): 15:15:43 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution 15:15:43 evaluator solution.run(cis) 15:15:43 evaluator File "solution.py", line 118, in run 15:15:43 evaluator solve(params, cis) 15:15:43 evaluator File "solution.py", line 83, in solve 15:15:43 evaluator observation, reward, done, info = env.step(action) 15:15:43 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step 15:15:43 evaluator return self.env.step(action) 15:15:43 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step 15:15:43 evaluator observation, reward, done, info = self.env.step(action) 15:15:43 evaluator File "/workspace/wrappers.py", line 89, in step 15:15:43 evaluator ob, reward, done, info = self.env.step(action) 15:15:43 evaluator File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step 15:15:43 evaluator observation, reward, done, info = self.env.step(action) 15:15:43 evaluator File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step 15:15:43 evaluator obs, rew, done, misc = self.sim.step(action, with_observation=True) 15:15:43 evaluator File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step 15:15:43 evaluator return self._failsafe_observe(msg) 15:15:43 evaluator File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe 15:15:43 evaluator raise Exception(msg) 15:15:43 evaluator Exception: Giving up to connect to the gym duckietown server at host: evaluator 15:15:43 evaluator 15:15:43 evaluator 15:15:43 evaluator 15:15:43 evaluator DEBUG:duckietown-challenges:Written to: /challenge-results/challenge_results.yaml