Do not keep track of outer objects for the robot. Use Problem for that, do not keep track of pairs of joints tested for collision and distance.