Work Item
ASTM WK87214
New Test Method for Standard test method for robotic assembly task boards: Benchmarking performance
1. Scope
This standard test method provides a procedure for benchmarking the performance of a robot system on manufacturing assembly-based tasks. The information provided in this test method includes guidance for test documentation, procedure for running the test method, and an example scoring mechanism. The goal of this standard is to quantify the capabilities and limitations of a robot system in a reliable and repeatable way such that results can be compared to other systems across research and industry.
Keywords
Assembly Task Board (ATB); Assembly; Disassembly; sub-assembly; kit mat
Rationale
Manufacturers and robotics researchers have long been promoting and testing their robot systems through the artifacts and test methods they design within their own lab spaces. This means that every test a user runs is designed differently than a test being run by another user. The artifacts used, test paradigm, and procedure being vastly different means there is little guarantee that the tests performed yield meaningful results since they cannot be compared to any other test. There have been many requests from industry to create a standard for benchmarking robotic assembly performance so that users have a definitive and comparable method for testing their systems on robotic assembly.
The title and scope are in draft form and are under development within this ASTM Committee.
Work Item Status
Date Initiated: 07-19-2023
Technical Contact: Kenneth Kimble
Item: 000
Ballot:
Status: