Links and approximate functional input/output between workpackages of POETICON++. WP2 and WP3 build a set of parsers to extract behavior trees from speech/text and visual data respectively. They produce a common representation in the form of behavior trees (cf. Pastra and Aloimonos 2012, on a generative grammar of action) which can be filled in with affordance nets developed in WP4 (e.g. action-tool and action-object and effect links). WP5 develops both the foundational underpinnings of the model (by looking at the connection between action and language in humans) and the basic action control tools required to generate a wide repertoire of actions. Task integration and validation of the model is carried out in WP6 and WP7 in the form of two different testbeds.
Working lunch on "European research leadership in robotics"