Work Item
ASTM WK87214

New Test Method for Standard test method for robotic assembly task boards: Benchmarking performance

1. Scope

This standard test method provides a procedure for benchmarking the performance of a robot system on manufacturing assembly-based tasks. The information provided in this test method includes guidance for test documentation, procedure for running the test method, and an example scoring mechanism. The goal of this standard is to quantify the capabilities and limitations of a robot system in a reliable and repeatable way such that results can be compared to other systems across research and industry.


Assembly Task Board (ATB); Assembly; Disassembly; sub-assembly; kit mat


Manufacturers and robotics researchers have long been promoting and testing their robot systems through the artifacts and test methods they design within their own lab spaces. This means that every test a user runs is designed differently than a test being run by another user. The artifacts used, test paradigm, and procedure being vastly different means there is little guarantee that the tests performed yield meaningful results since they cannot be compared to any other test. There have been many requests from industry to create a standard for benchmarking robotic assembly performance so that users have a definitive and comparable method for testing their systems on robotic assembly.

The title and scope are in draft form and are under development within this ASTM Committee.


Developed by Subcommittee: F45.05

Committee: F45

Staff Manager: Nora Nimmerichter

Work Item Status

Date Initiated: 07-19-2023

Technical Contact: Kenneth Kimble

Item: 000