Magna International is a leading global automotive part supplier. By utilizing its 158,000 employees, throughout 342 manufacturing operations, across 27 countries, they foster innovation and push the boundaries of sustainable auto-production.

Computer-aided design (CAD) is the industry standard for creating 2D and 3D models. Due to the rising level of proficiency required for production-level CAD, modeling is typically restricted to highly experienced users.

Our VR Human-AI Multimodal Interaction application empowers less experienced users by enabling advanced CAD operations through human-AI interaction. This vastly simplifies the design process and minimizes the CAD expertise required for advanced modeling.

Users utilize speech commands paired with interconnected AI models to invoke both specific and general object manipulation. Existing models can be quickly edited with a single sentence to meet new specifications. This bypasses the elaborate manual design process, enables engineers of varying design experience, and reduces production time.

Engineers and designers interact with their models in a 3D environment using virtual reality. Simple hand gestures and voice commands are used to manipulate and edit the model.

Our application bridges the gap between advanced and intermediate CAD designers by applying cutting-edge agentic technologies, saving time spent designing CAD models.

The front end of our VR Human-AI Multimodal Interaction is built using CSS, HTML and Next.js, while the back end is implemented using Typescript, Python and Node.js. They interact with one another through artificial intelligence reliant services such as OpenAI, FreeCAD MCP and Azure Blob storage.