Deep reinforcement learning for the design of mechanical metamaterials with tunable deformation and hysteretic characteristics

Abstract

Mechanical metamaterials are regularly implemented in engineering applications due to their unique properties derived from their structural geometry and material composition. This study incorporates deep reinforcement learning, a subset of machine learning that teaches an agent to complete a task through interactive experiences, into mechanical metamaterial design. The approach creates a design environment for the reinforcement learning agent to iteratively construct metamaterials with tailorable deformation and hysteretic characteristics. Validation involved producing metamaterials with a thermoplastic polyurethane (TPU) base material that exhibited the deformation response of expanded thermoplastic polyurethane (E-TPU) while maximizing or minimizing hysteresis in cyclic compression. This alignment confirmed the feasibility of tailoring deformation and energy manipulation using mechanical metamaterials. The agent's generalizability was tested by tasking it to create various metamaterials with distinct loading deformation responses and specific hysteresis goals in a simulated setting. The agent consistently delivered metamaterials that met loading curve criteria and demonstrated favorable energy return. This work demonstrates the potential of deep reinforcement learning as a rapid and effective tool for designing mechanical metamaterials with customizable traits. It ushers in the possibility of on-demand metamaterial design solutions, opening avenues across industries like footwear, wearables, and medical equipment.