MIT News breed · Science

InstructMesh: AI Tool for Practical 3D Model Design

Researchers developed InstructMesh, an AI tool enabling users to design and refine 3D models for practical use, bridging AI generation with real-world functionality.

AI can generate 3D designs but often produces impractical objects. Editing these models is also challenging for novices. InstructMesh allows users to prompt AI for designs and refine parts before 3D printing.

Developed by MIT CSAIL, Google, and Northeastern University, InstructMesh combines Microsoft's TRELLIS with GPT-4. This allows the tool to understand visual and textual information for functional designs.

The tool created unique items like a dragon-handled mug and butterfly-winged glasses. It also aids in practical applications, such as custom knee braces or robot enclosures.

To test usability, novices used InstructMesh to fix flawed 3D models. They accurately identified and corrected issues, showing the tool's intuitive interface.

InstructMesh simplifies modeling via natural language edits, translated into geometric changes users can approve.

Future plans include AR integration for context-aware design and physics simulations for object behavior prediction.

AI-samenvatting op basis van de bron.