04:12:18 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 04:12:21 evaluator INFO:duckietown-challenges:evaluation: Preparing here.. 04:12:21 evaluator INFO:duckietown-challenges:evaluation: Solution parameters: OrderedDict([('env', 'Duckietown-Lf-Lfv-Navv-Silent-v1')]) 04:12:21 evaluator DEBUG:duckietown-challenges:evaluation: gym started with pid = 12 04:12:21 evaluator INFO:duckietown-challenges:evaluation: Waiting for Gym to activate... 04:12:21 evaluator INFO:duckietown-challenges:evaluation: Preparation done. 04:12:21 evaluator DEBUG:duckietown-challenges:Written to: /challenge-description/description.yaml 04:12:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (0 secs passed, will wait 600 secs more) 04:12:21 evaluator launch.sh > Starting xvfb 04:12:21 evaluator launch.sh > Started xvfb with PID 14 04:12:21 evaluator launch.sh > Now running gym_simulation_launcher.py 04:12:21 evaluator INFO:duckietown-challenges:duckietown-challenges 3.2.12 04:12:21 evaluator INFO:duckietown-slimremote:duckietown-slimremote 2018.10.1 04:12:21 evaluator INFO:gym-duckietown:gym-duckietown 2018.10.1 04:12:21 evaluator 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_empty-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-test_loop_obstacles-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_dyn_duckiebots-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-4way-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-udem1-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_obstacles-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-small_loop_cw-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-straight_road-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-loop_pedestrians-v0 04:12:21 evaluator INFO:gym-duckietown:Registering gym environment id: Duckietown-zigzag_dists-v0 04:12:22 evaluator WARNING:rosout:Failed to load Python extension for LZ4 support. LZ4 compression will not be available. 04:12:22 evaluator launcher|gym_simulation_launcher.py:48 - main | launcher parameters: 04:12:22 evaluator 04:12:22 evaluator { 04:12:22 evaluator "challenge": "LF", 04:12:22 evaluator "episodes": 5, 04:12:22 evaluator "steps_per_episode": 500, 04:12:22 evaluator "environment-constructor": "Simulator", 04:12:22 evaluator "include_map": true, 04:12:22 evaluator "environment-parameters": { 04:12:22 evaluator "seed": 123, 04:12:22 evaluator "map_name": "loop_empty", 04:12:22 evaluator "max_steps": 500001, 04:12:22 evaluator "domain_rand": 0, 04:12:22 evaluator "camera_width": 640, 04:12:22 evaluator "camera_height": 480, 04:12:22 evaluator "accept_start_angle_deg": 4, 04:12:22 evaluator "full_transparency": true, 04:12:22 evaluator "distortion": true 04:12:22 evaluator }, 04:12:22 evaluator "agent-info": { 04:12:22 evaluator "challenge": "LF" 04:12:22 evaluator } 04:12:22 evaluator } 04:12:22 evaluator launcher|gym_simulation_launcher.py:59 - main | using gym-duckietown version 2018.10.1 04:12:22 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 04:12:22 evaluator gym-duckietown| graphics.py:121 - create_frame_buffers| Falling back to non-multisampled frame buffer 04:12:22 evaluator gym-duckietown| simulator.py:490 - _load_map | loading map file "/workspace/gym-duckietown/gym_duckietown/maps/loop_empty.yaml" 04:12:22 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.obj" 04:12:22 evaluator gym-duckietown| objmesh.py:238 - _load_mtl | loading materials from "/workspace/gym-duckietown/gym_duckietown/meshes/duckiebot.mtl" 04:12:23 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/duckie.obj" 04:12:23 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/duckie.png" 04:12:23 evaluator gym-duckietown| objmesh.py:50 - __init__ | loading mesh "/workspace/gym-duckietown/gym_duckietown/meshes/cone.obj" 04:12:23 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/cone.png" 04:12:23 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/floor_1.png" 04:12:23 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_left_1.png" 04:12:23 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/straight_1.png" 04:12:23 evaluator gym-duckietown| graphics.py:60 - load_texture | loading texture "/workspace/gym-duckietown/gym_duckietown/textures/curve_right_1.png" 04:12:23 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [4.05833625 0. 2.17835003] 1.62929007381 04:12:25 evaluator launcher|gym_simulation_launcher.py:74 - main | Logging gym state to: /tmp/tmp_1bumh/episodes 04:12:25 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [2.75442323 0. 3.0079666 ] 4.83604950287 04:12:25 evaluator launcher|gym_simulation_launcher.py:89 - main | Simulator listening to incoming connections... 04:12:25 evaluator launcher|gym_simulation_launcher.py:98 - main | Starting episode ep000 04:12:25 evaluator launcher|gym_simulation_launcher.py:104 - main | Logging basic info 04:12:25 evaluator launcher|gym_simulation_launcher.py:109 - main | Now running episode 04:12:25 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.57449761 0. 1.00806868] 0.0328325810557 04:12:30 evaluator launcher|gym_simulation_launcher.py:237 - run_episode | received ping: {u'topic': 1, u'ip': u'172.19.0.3', u'id': u'2937', u'msg': u'0'} 04:12:30 evaluator launcher|gym_simulation_launcher.py:240 - run_episode | received 2, resetting: {u'topic': 2, u'ip': u'172.19.0.3', u'id': u'2937', u'msg': u'0'} 04:12:30 evaluator gym-duckietown| simulator.py:471 - reset | Starting at [3.9473256 0. 2.19364627] 4.70207132071 04:12:31 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (10 secs passed, will wait 590 secs more) 04:12:41 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (20 secs passed, will wait 580 secs more) 04:12:51 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (30 secs passed, will wait 570 secs more) 04:13:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (40 secs passed, will wait 560 secs more) 04:13:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (50 secs passed, will wait 550 secs more) 04:13:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (60 secs passed, will wait 540 secs more) 04:13:31 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (70 secs passed, will wait 530 secs more) 04:13:41 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (80 secs passed, will wait 520 secs more) 04:13:51 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (90 secs passed, will wait 510 secs more) 04:14:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (100 secs passed, will wait 500 secs more) 04:14:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (110 secs passed, will wait 490 secs more) 04:14:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (120 secs passed, will wait 480 secs more) 04:14:31 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (130 secs passed, will wait 470 secs more) 04:14:41 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (140 secs passed, will wait 460 secs more) 04:14:51 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (150 secs passed, will wait 450 secs more) 04:15:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (160 secs passed, will wait 440 secs more) 04:15:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (170 secs passed, will wait 430 secs more) 04:15:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (180 secs passed, will wait 420 secs more) 04:15:31 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (190 secs passed, will wait 410 secs more) 04:15:41 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (200 secs passed, will wait 400 secs more) 04:15:51 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (210 secs passed, will wait 390 secs more) 04:16:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (220 secs passed, will wait 380 secs more) 04:16:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (230 secs passed, will wait 370 secs more) 04:16:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (240 secs passed, will wait 360 secs more) 04:16:31 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (250 secs passed, will wait 350 secs more) 04:16:41 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (260 secs passed, will wait 340 secs more) 04:16:51 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (270 secs passed, will wait 330 secs more) 04:17:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (280 secs passed, will wait 320 secs more) 04:17:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (290 secs passed, will wait 310 secs more) 04:17:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (300 secs passed, will wait 300 secs more) 04:17:31 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (310 secs passed, will wait 290 secs more) 04:17:41 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (320 secs passed, will wait 280 secs more) 04:17:51 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (330 secs passed, will wait 270 secs more) 04:18:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (340 secs passed, will wait 260 secs more) 04:18:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (350 secs passed, will wait 250 secs more) 04:18:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (360 secs passed, will wait 240 secs more) 04:18:31 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (370 secs passed, will wait 230 secs more) 04:18:41 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (380 secs passed, will wait 220 secs more) 04:18:51 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (390 secs passed, will wait 210 secs more) 04:19:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (400 secs passed, will wait 200 secs more) 04:19:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (410 secs passed, will wait 190 secs more) 04:19:20 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (419 secs passed, will wait 181 secs more) 04:19:30 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (429 secs passed, will wait 171 secs more) 04:19:40 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (439 secs passed, will wait 161 secs more) 04:19:50 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (449 secs passed, will wait 151 secs more) 04:20:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (459 secs passed, will wait 141 secs more) 04:20:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (469 secs passed, will wait 131 secs more) 04:20:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (479 secs passed, will wait 121 secs more) 04:20:31 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (489 secs passed, will wait 111 secs more) 04:20:41 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (499 secs passed, will wait 101 secs more) 04:20:51 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (509 secs passed, will wait 91 secs more) 04:21:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (519 secs passed, will wait 81 secs more) 04:21:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (530 secs passed, will wait 70 secs more) 04:21:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (539 secs passed, will wait 61 secs more) 04:21:31 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (550 secs passed, will wait 50 secs more) 04:21:41 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (560 secs passed, will wait 40 secs more) 04:21:51 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (570 secs passed, will wait 30 secs more) 04:22:01 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (580 secs passed, will wait 20 secs more) 04:22:11 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (590 secs passed, will wait 10 secs more) 04:22:21 evaluator DEBUG:duckietown-challenges:Output /challenge-solution-output/output-solution.yaml not ready yet (600 secs passed, will wait 0 secs more) 04:22:21 evaluator ERROR:duckietown-challenges:declare failed: 04:22:21 evaluator InvalidSubmission: 04:22:21 evaluator Traceback (most recent call last): 04:22:21 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator 04:22:21 evaluator cie.wait_for_solution() 04:22:21 evaluator File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution 04:22:21 evaluator raise InvalidSubmission(msg) 04:22:21 evaluator InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml. 04:22:21 evaluator 04:22:21 evaluator DEBUG:duckietown-challenges:Written to: /challenge-results/challenge_results.yaml