This week, RoCKIn released its first report, with contributions from many prominent experts in robotics. Dealing with the general features of scenarios and robots for benchmarking through competitions, this report states the goals and motivations of the RoCKIn Challenge.
After explaining the general approach used by RoCKIn, the report presents user stories for both RoCKIn@Work and RoCKIn@Home. These should help determine the scenarios and robots to be used in benchmarking and competitions. For example, the story of Granny Annie whose robots help her in her daily routine would tell you what sort of innovations the RoCKIn@Home Challenge is looking up to and what features matters when developing a scenario.
This report also looks at other robots competitions (the AAAI Mobile Robot Competition and Exhibition, RoboCup and the DARPA Challenges) as examples of what is or has been done to underline where the RoCKIn project idea comes from. The complete version of this report then explains what is specific about the RoCKIn approach, while the short version directly draws conclusions about scenario features.
These conclusions are enhanced in the complete version by remarks about the use of a Functional Reference Platform (FRP). With the FRP, one robot is not considered as a whole but each of its functional areas will be considered separately. The sharing of the most advanced functional modules from prior parts of the Challenges will develop the community and help every team, newcomers or previous competitors, to stay up to speed. It also aims at defining more precisely what functionalities from robots of the RoCKIn Challenges are to be benchmarked using generated data or simple observation of their capacities.
Finally, both versions of the report examine benchmarking, scoring and ranking methods in related fields, such as Science and Sports, for information and comparison purposes.
All those stories and features are for discussion between the RoCKIn participants and should inspire you to develop relevant tools for benchmarking the competition and your own scenarios. To get inspired and share your thoughts with the community, you can always start a new topic or contribute to an existing one using our Forum application in this website. It’s very easy to join in, and start discussing the project with other people around the world... you will help enhance the RoCKIn challenges!
The full report is now available on our Publications page here. The short version of this report is also available here.
You can discuss it and exchange with the RoCKIn community in our Forum.