Project Overview
XRTwinScape revolutionizes workforce training by enabling effective preparation in realistic, virtual environments without the inherent risks and limitations of physical spaces. Our innovative solution leverages highly detailed 1:1 virtual representations of physical workspaces (digital twins) and immersive training lessons for contextualized learning.
We utilize cutting-edge technology, including Gaussian Splatting, an AI-powered rendering technique, for rapid, high-fidelity digital twin creation that preserves exceptional visual detail.
Key Components
TwinScape Editor (New Enabler)
An intuitive web application that empowers users to:
- Generate digital twins of real-world work scenarios from simple photographs.
- Augment these digital twins with interactive educational content, creating XR training lessons.
- Publish lessons seamlessly to the XR2Learn platform.
TwinScape Player (New Beacon Application)
An immersive XR application that allows trainees to:
- Interact with digital twins downloaded from the XR2Learn platform marketplace.
- Engage in task-based learning within these realistic virtual environments.
Project Objectives
- Enhance Digitalization: Improve our technology for creating faithful digital twins of work environments, complete with multimodal attachments.
- Platform Integration: Seamlessly integrate these digital twins into the XR2Learn platform, making them accessible as marketplace assets.
- Develop the XRTwinScape System: Design and build the TwinScape Editor, TwinScape Player, and TwinScapeLesson assets.
- Validate through Use Cases: Design, implement, and evaluate three distinct Industry 5.0 use case scenarios using the XR2Learn Educational Framework and the ASSURE model.
Target Use Cases & Pilot Programs
XRTwinScape will be validated through three pilot use cases aligned with Industry 5.0 principles, involving 220 trainees across three educational applications:
Industrial Training for Unemployed Individuals
Providing 60 participants with foundational knowledge of industrial tools and electrical panels in a safe, virtual replica of Formamentis' industrial plant technician lab, enhancing employability.
Problem-Solving for Employees
Targeting 60 company employees to improve their ability to analyze problems, evaluate alternatives, and execute timely solutions within virtualized industrial systems under pressure.
Career Guidance for High School Students
Introducing 100 high school students to Industry 5.0 concepts through virtual plant tours, enhancing their understanding of industrial processes, technologies, and career opportunities.
Technology Highlight: Gaussian Splatting
XRTwinScape leverages Gaussian Splatting, a novel AI-based rendering technique that:
- Creates highly detailed and faithful 3D reconstructions of real-world spaces from standard images or videos.
- Offers significant advantages over traditional methods like photogrammetry by simplifying scene representation, improving visual quality (especially on reflective surfaces), and enabling real-time rendering.
- Reduces the time and cost associated with creating virtual environments, making advanced XR training more accessible.
Example of a reconstruction made with Gaussian Splatting technology.
Benefits of XRTwinScape
Enhanced Realism & Relevance
Accurate replication of work environments for realistic simulations, improving training effectiveness.
Increased Engagement
Immersive lessons and interactive content boost learner engagement and knowledge retention.
Cost & Time Efficiency
Drastic reduction in costs and time for virtual environment creation using Gaussian Splatting.
Accessibility & Scalability
Enables remote training at scale and broad access to quality resources.
Collaboration & Customization
Open-source tools encourage collaboration and adaptation across industries.
Future-Proofing
Designed for sustainability as a SaaS cloud platform beyond the project's duration.
The Consortium
XRTwinScape is a collaborative effort bringing together the expertise of three key partners:
Formamentis SPA (FMTS)
Coordinator
Expertise in education, employment services, industrial training (Eduwork complex).
CeRICT scrl
Research & Development
Expertise in XR, digital reconstruction, AI, cybersecurity (Univ. of Salerno - ISISLab).
Picaresque SRL (PICA)
Software & XR Development
Specializes in immersive video games, XR applications, gamification.
Future Vision & Sustainability
Beyond the initial project phase, XRTwinScape aims to be a sustainable resource for institutions and industries. It will be offered as a Software as a Service (SaaS) cloud platform, providing ongoing access to its powerful tools for improving training processes and workforce preparedness.
Picaresque also plans to establish an independent publishing platform, TwinScapeWorld, to ensure the long-term accessibility of training materials and resources developed during the project. This platform will allow users to upload, share (free or paid), and access digital twins and TwinScapeLessons, extending the project's impact.