10:53:57 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 10:53:57 evaluator INFO:duckietown-challenges:evaluation: Preparing here.. 10:53:57 evaluator INFO:duckietown-challenges:evaluation: Solution parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 10:53:57 evaluator DEBUG:duckietown-challenges:evaluation: gym started with pid = 25 10:53:57 evaluator INFO:duckietown-challenges:evaluation: Waiting for Gym to activate... 10:53:57 evaluator INFO:duckietown-challenges:evaluation: Preparation done. 10:53:57 evaluator DEBUG:duckietown-challenges:Written to: /challenge-description/description.yaml 10:53:57 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (0 secs passed, will wait 600 secs more) 10:53:57 evaluator launch.sh > Starting xvfb 10:53:57 evaluator launch.sh > Started xvfb with PID 27 10:53:57 evaluator launch.sh > Now running gym_simulation_launcher.py 10:53:57 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 10:53:58 evaluator INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 10:53:58 evaluator INFO:gym-duckietown:gym-duckietown 2018.10.1 10:53:58 evaluator 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-straight_road-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-zigzag_dists-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_pedestrians-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-test_loop_obstacles-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_empty-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_dyn_duckiebots-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-udem1-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop_cw-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-4way-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop-v0 10:53:58 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_obstacles-v0 10:53:58 evaluator WARNING:rosout:Failed to load Python extension for LZ4 support. LZ4 compression will not be available. 10:53:58 evaluator launcher|gym_simulation_launcher.py:48 - main | launcher parameters: 10:53:58 evaluator 10:53:58 evaluator { 10:53:58 evaluator "challenge": "LF", 10:53:58 evaluator "episodes": 5, 10:53:58 evaluator "steps_per_episode": 500, 10:53:58 evaluator "environment-constructor": "Simulator", 10:53:58 evaluator "include_map": true, 10:53:58 evaluator "environment-parameters": { 10:53:58 evaluator "seed": 123, 10:53:58 evaluator "map_name": "loop_empty", 10:53:58 evaluator "max_steps": 500001, 10:53:58 evaluator "domain_rand": 0, 10:53:58 evaluator "camera_width": 640, 10:53:58 evaluator "camera_height": 480, 10:53:58 evaluator "accept_start_angle_deg": 4, 10:53:58 evaluator "full_transparency": true, 10:53:58 evaluator "distortion": true 10:53:58 evaluator }, 10:53:58 evaluator "agent-info": { 10:53:58 evaluator "challenge": "LF" 10:53:58 evaluator } 10:53:58 evaluator } 10:53:58 evaluator launcher|gym_simulation_launcher.py:59 - main | using gym-duckietown version 2018.10.1 10:53:58 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 10:53:58 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 10:53:58 evaluator gym-duckietown| simulator.py:490 - _load_map | loading map file "/workspace/gym-duckietown/gym_duckietown/maps/loop_empty.yaml" 10:53:58 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.obj" 10:53:58 evaluator gym-duckietown| objmesh.py:238 - _load_mtl | loading materials from "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.mtl" 10:53:59 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckie.obj" 10:53:59 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/duckie.png" 10:53:59 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/cone.obj" 10:53:59 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/cone.png" 10:53:59 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/floor_1.png" 10:54:00 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_left_1.png" 10:54:00 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/straight_1.png" 10:54:00 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_right_1.png" 10:54:00 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [4.05833625 0. 2.17835003] 1.62929007381 10:54:03 evaluator launcher|gym_simulation_launcher.py:74 - main | Logging gym state to: /tmp/tmpmGk10a/episodes 10:54:03 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [2.75442323 0. 3.0079666 ] 4.83604950287 10:54:03 evaluator launcher|gym_simulation_launcher.py:89 - main | Simulator listening to incoming connections... 10:54:03 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep000 10:54:03 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 10:54:03 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 10:54:03 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.57449761 0. 1.00806868] 0.0328325810557 10:54:03 evaluator launcher|gym_simulation_launcher.py:237 - run_episode | received ping: {u'topic': 1, u'ip': u'172.20.0.2', u'id': u'88332', u'msg': u'0'} 10:54:03 evaluator launcher|gym_simulation_launcher.py:240 - run_episode | received 2, resetting: {u'topic': 2, u'ip': u'172.20.0.2', u'id': u'88332', u'msg': u'0'} 10:54:03 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.9473256 0. 2.19364627] 4.70207132071 10:54:07 evaluator gym-duckietown| simulator.py:1244 - step | Stopping the simulator because we are at an invalid pose. 10:54:07 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep000 10:54:07 evaluator launcher|gym_simulation_launcher.py:122 - main | episode too short with 6 steps 10:54:07 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep000 10:54:07 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 10:54:07 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 10:54:07 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.94220351 0. 1.23114947] 4.68721314392 10:54:07 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (10 secs passed, will wait 590 secs more) 10:54:11 evaluator gym-duckietown| simulator.py:1244 - step | Stopping the simulator because we are at an invalid pose. 10:54:11 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep000 10:54:11 evaluator launcher|gym_simulation_launcher.py:119 - main | 12 steps are enough 10:54:11 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep001 10:54:11 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 10:54:11 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 10:54:11 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [0.84497723 0. 1.12248482] 4.62469817798 10:54:16 evaluator gym-duckietown| simulator.py:1244 - step | Stopping the simulator because we are at an invalid pose. 10:54:16 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep001 10:54:16 evaluator launcher|gym_simulation_launcher.py:119 - main | 13 steps are enough 10:54:16 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep002 10:54:16 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 10:54:16 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 10:54:16 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.00329777 0. 0.86708317] 0.0349480490083 10:54:17 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (20 secs passed, will wait 580 secs more) 10:54:20 evaluator gym-duckietown| simulator.py:1244 - step | Stopping the simulator because we are at an invalid pose. 10:54:20 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep002 10:54:20 evaluator launcher|gym_simulation_launcher.py:122 - main | episode too short with 9 steps 10:54:20 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep002 10:54:20 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 10:54:20 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 10:54:20 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [1.72410152 0. 3.21929481] 0.0317184229532 10:54:24 evaluator gym-duckietown| simulator.py:1244 - step | Stopping the simulator because we are at an invalid pose. 10:54:24 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep002 10:54:24 evaluator launcher|gym_simulation_launcher.py:122 - main | episode too short with 9 steps 10:54:24 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep002 10:54:24 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 10:54:24 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 10:54:24 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [1.71140436 0. 0.7361902 ] 0.0508532557804 10:54:27 evaluator DEBUG:duckietown-challenges:Output /challenge-solut10:53:56 solution INFO:gym-duckietown-agent:gym-duckietown-agent 2018.10.1 10:53:56 solution INFO:duckietown-challenges:duckietown-challenges 3.2.14 10:53:56 solution DEBUG:duckietown-challenges:Output /challenge-description/description.yaml not ready yet (0 secs passed, will wait 600 secs more) 10:53:58 solution INFO:duckietown-challenges:solution:Parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 10:53:58 solution INFO:duckietown-challenges:solution:Starting. 10:53:58 solution INFO:duckietown-challenges:solution:Creating model. 10:53:58 solution INFO:duckietown-challenges:solution:Making environment 10:53:58 solution INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 10:53:59 solution INFO:duckietown-challenges:solution:Reset environment 10:54:02 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 10:54:06 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 10:54:10 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 10:54:14 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 10:54:19 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 10:54:23 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 10:54:27 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 10:54:31 solution INFO:duckietown-slimremote:Simulator not ready - wait 1 second and try again 10:54:32 solution INFO:duckietown-challenges:solution:Finished. 10:54:32 solution DEBUG:duckietown-challenges:Written to: /challenge-solution-output/output-solution.yaml 10:54:33 solution INFO:duckietown-challenges:solution:Graceful termination of wrap_solution(). 10:54:33 solution Starting submission 10:54:33 solution (u'starting sub socket on', 8902) ion-output/output-solution.yaml not ready yet (30 secs passed, will wait 570 secs more) 10:54:28 evaluator gym-duckietown| simulator.py:1244 - step | Stopping the simulator because we are at an invalid pose. 10:54:28 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep002 10:54:28 evaluator launcher|gym_simulation_launcher.py:122 - main | episode too short with 8 steps 10:54:28 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep002 10:54:28 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 10:54:28 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 10:54:29 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [2.65733059 0. 2.53968888] 3.71783871533 10:54:32 evaluator gym-duckietown| simulator.py:1244 - step | Stopping the simulator because we are at an invalid pose. 10:54:32 evaluator launcher|gym_simulation_launcher.py:116 - main | Finished episode ep002 10:54:32 evaluator launcher|gym_simulation_launcher.py:122 - main | episode too short with 2 steps 10:54:32 evaluator launcher|gym_simulation_launcher.py:134 - main | Anomalous error while running episodes: 10:54:32 evaluator Traceback (most recent call last): 10:54:32 evaluator File "gym_simulation_launcher.py", line 94, in main 10:54:32 evaluator raise Exception(msg) # XXX 10:54:32 evaluator Exception: Too many failures: 5 10:54:32 evaluator 10:54:32 evaluator launcher|gym_simulation_launcher.py:140 - main | Simulation done. 10:54:32 evaluator launcher|gym_simulation_launcher.py:265 - <module> | anomalous exit of gym_simulation_launcher: 10:54:32 evaluator Traceback (most recent call last): 10:54:32 evaluator File "gym_simulation_launcher.py", line 262, in <module> 10:54:32 evaluator main() 10:54:32 evaluator File "gym_simulation_launcher.py", line 94, in main 10:54:32 evaluator raise Exception(msg) # XXX 10:54:32 evaluator Exception: Too many failures: 5 10:54:32 evaluator 10:54:32 evaluator starting pub socket on port 8902 10:54:33 evaluator launch.sh > gym_simulation_launcher terminated with return code 2 10:54:33 evaluator launch.sh > Killing xvfb... 10:54:33 evaluator launch.sh > Killed. 10:54:33 evaluator launch.sh > Graceful exit of launch.sh with return code 2 10:54:33 evaluator INFO:duckietown-challenges:evaluation: waiting for gym to finish 10:54:33 evaluator INFO:duckietown-challenges:evaluation: finished with return code 2 10:54:33 evaluator ERROR:duckietown-challenges:declare error: 10:54:33 evaluator InvalidEvaluator: 10:54:33 evaluator Traceback (most recent call last): 10:54:33 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator 10:54:33 evaluator evaluator.score(cie) 10:54:33 evaluator File "eval.py", line 96, in score 10:54:33 evaluator raise dc.InvalidEvaluator(msg) 10:54:33 evaluator InvalidEvaluator: Gym exited with code 2 10:54:33 evaluator 10:54:33 evaluator DEBUG:duckietown-challenges:Written to: /challenge-results/challenge_results.yaml