The primary challenge was to create a realistic and interactive simulation that could be used both for presentations and training purposes. This simulation needed to support AR and VR modes, allowing users to experience the system with or without a physical gearbox. Additionally, it required the ability to display various speeds and driving modes, along with a comprehensive visualization of hydraulic and mechanical power flow.
To tackle this challenge, together with Luxoom, we focused on developing detailed user stories and a concept, followed by designing an intuitive UI/UX.
Leveraging the open .USD data format, we built a conversion pipeline from CAD to .USD, ensuring seamless integration of .USD data into the Apple Reality Kit. This allowed for precise and realistic simulations in both AR and VR modes. Our platform further enhanced the development process, enabling robust simulation capabilities and user interactions.
The solution also included adaptive environment shading and occlusion in AR mode, enhancing the realism and immersion of the simulation.
The implementation of this advanced simulation brings significant benefits to CLAAS. It provides an immersive and interactive tool that enhances training and presentation capabilities. Users now can experience the gear shift system in a highly realistic virtual environment, with the flexibility to explore different operational modes and understand the underlying power flow. The integration of AR and VR modes makes training sessions more engaging and informative, leading to better knowledge retention.
