FSU Metaverse MVP - Dev Log
Completed Project

FSU Metaverse MVP & Career Center

Gamifying career development through immersive technology

Role
Senior Technical Artist & Lead Developer
Timeline
3.5 Months
Engine
Unreal Engine 5
Team Size
Rapid Prototype
Designed as an interactive hub for career readiness at Future State University, this Metaverse MVP merged procedural generation, generative AI, and high-fidelity animation into a cohesive, functional demo—delivered under extreme time pressure.
🌍

Procedural World Building

Architecting the campus environment with Houdini-driven pipelines

Design Pipeline

Civil3D / AutoCAD Drafting Workflow

Engineered the campus layout using professional civil engineering software for rapid, standards-compliant design iterations.

Civil3D AutoCAD Engineering Standards Site Planning
📐

Engineering-First Design Approach

Drafted the entire campus layout in Civil3D and AutoCAD, adhering to real-world civil engineering standards. This ensured accurate measurements, proper grading, and realistic site constraints from the ground up.

🔄

Rapid Design Iterations

The CAD-based workflow allowed for quick modifications to campus layout, building placements, and road networks. Design changes that would take weeks in traditional 3D modeling took hours in Civil3D.

📏

Clean Linework for Pipeline Export

Created precise, measured linework with proper layer organization and engineering metadata. This clean data became the foundation for the entire procedural generation pipeline downstream.

🎓

Student-Centric Design

Campus layout was drafted based on the actual functions and needs of students—classroom clustering, pedestrian flow patterns, social spaces, and accessibility requirements informed every design decision.

Pipeline Integration

CAD-to-Engine Data Pipeline

Seamless transfer of linework from Civil3D into Unreal Engine for procedural generation workflows.

DXF Import Spline Conversion Unreal Engine 5 Houdini
📥

Linework-to-Spline Pipeline

Developed an automated workflow to import CAD linework directly into Unreal Engine as spline data. Roads, pathways, building footprints, and utility lines maintained their engineering precision through the conversion.

⚙️

Houdini Digital Assets Integration

Exported spline data fed directly into Houdini Digital Assets (HDAs), driving procedural generation of roads, terrain adaptation, building placement, and environmental storytelling elements.

🔵

Unreal Procedural Blueprints

Spline data also powered native UE5 Procedural Blueprints, enabling real-time adjustments to the campus layout within the engine while maintaining the engineering-validated foundation from Civil3D.

🔗

Bi-Directional Workflow

Changes made in Civil3D could be re-imported without breaking existing work, allowing stakeholders to request layout adjustments late in production while preserving generated content.

Technical Innovation

Houdini Procedural Generation

Abandoned manual placement in favor of custom procedural tools built in Houdini.

Houdini Unreal Engine 5 Python HDA Tools

Engineering Standards Integration

Integrated real-world civil engineering drafting standards directly into the generation logic, ensuring the campus layout was not only visually cohesive but architecturally grounded.

Rapid Iteration Capability

The procedural pipeline allowed for rapid iteration of environment layouts without sacrificing detail, enabling multiple complete campus redesigns within days rather than weeks.

🔧

Custom HDA Tools

Built reusable Houdini Digital Assets that the team could deploy directly in UE5, empowering non-technical team members to generate complex environment variations.

🤖

AI-Powered Career Simulation

Integrating OpenAI API for immersive interview and assessment systems

Core Feature

AI Career Coaches

Four specialized AI guides with unique personas, each providing personalized guidance based on your learning and career journey context.

OpenAI GPT-4 RAG Architecture Context Memory NPC System
🎓

Mentor - The Learning Coach

Focuses on skill development and educational pathways. Analyzes your current knowledge gaps and recommends courses, certifications, and learning resources tailored to your career goals.

💼

Scout - The Job Hunter

Specializes in job market navigation and opportunity identification. Provides real-time insights on industry trends, connects your skills to open positions, and strategizes your application approach.

🌱

Sage - The Growth Advisor

Concentrates on professional and personal development. Offers guidance on soft skills, leadership qualities, networking strategies, and building a sustainable, fulfilling career path.

🔍

Pathfinder - The Explorer

Helps discover and align your interests with career potential. Uses conversational exploration to uncover hidden passions and map them to viable career trajectories you may not have considered.

🧠

Shared Context System

All four coaches share a unified memory of your journey—conversations, assessments, and progress are synchronized across the AI team, ensuring consistent, personalized guidance no matter which coach you engage with.

Core Feature

Mock Interview Module

Voice-based AI interview system with resume analysis and job-specific scoring.

OpenAI API C++ Python Voice Recognition
🎤

Resume-to-Interview Pipeline

Users upload their actual resumes which are parsed and analyzed to generate personalized, job-specific interview questions delivered by AI NPCs.

📊

Performance Scoring

The system analyzes audio responses in real-time, scoring users against specific job descriptions and providing actionable feedback on their interview performance.

Anti-Cheat

Response Authenticity Detection

Engineered logic to distinguish genuine human responses from AI-generated answers.

Audio Analysis ML Detection Behavioral Analysis
🛡️

Multi-Layer Verification

Prioritized audio analysis to verify soft skills authenticity, detecting patterns indicative of AI-scraping versus genuine human speech patterns and emotional cues.

🎯

Integrity-First Design

Built the system with assessment integrity as the primary constraint, ensuring the platform genuinely tests user capabilities rather than their prompt engineering skills.

Assessment

Holland Code Assessment

Visual-first multiple-choice test for career interest profiling.

UI/UX Design Data Visualization Career Mapping
🎨

Visual-First Interface

Designed an engaging, game-like assessment experience that transforms traditional career testing into an immersive world exploration activity.

🗺️

Career Path Mapping

Results are mapped to potential job paths within the metaverse world, creating immediate context and relevance for students exploring their career options.

🎬

Motion Capture & Cinematics

Owning the animation pipeline from performance to engine

Showcase

The Drone Tour Intro

Cinematic sequence introducing users to the campus through a creative drone interaction.

Motion Capture Sequencer Cinematics Character Animation
🎭

Performance Capture

Personally choreographed and enacted motion capture sessions, performing all character movements to create a unique, cohesive animation style throughout the experience.

🚁

Creative Drone Interaction

Designed and animated a signature moment where the user grabs a drone from mid-air, transforming it into a selfie-cam for an innovative campus tour introduction.

Animation Tech

Real-Time Lip-Sync System

Dynamic facial animation for text and voice-driven NPC interactions.

Live Link Facial Animation Audio2Face MetaHuman
💬

Dual Input Support

Implemented real-time lip-sync that works seamlessly with both pre-written text dialogue and dynamic voice AI responses, maintaining immersion across all NPC interactions.

Performance Optimized

System runs efficiently in real-time without pre-baking, enabling truly dynamic conversations while maintaining high-fidelity facial animation quality.

Pipeline

Full Animation Pipeline

End-to-end ownership from mocap stage to engine integration.

Maya MotionBuilder UE5 Animation Retargeting
🔄

Pipeline Architecture

Designed and maintained the complete animation pipeline, from raw mocap data cleanup in MotionBuilder to final engine integration with proper retargeting and blend setups.

👥

Diverse NPC Behaviors

Created a library of distinct character animations covering idle behaviors, gestures, and contextual reactions that bring the campus population to life.

3.5
Months
3
Core Systems
Iterations
100%
Delivered

The Result

Despite a high-pressure 3.5-month development window, the project successfully demonstrated complex platform capabilities—merging procedural generation, generative AI, and high-fidelity character animation into a cohesive, functional demo that set a new standard for immersive career development tools.

Images below are in order of progression

Previous
Previous

Trellis2 Blog

Next
Next

Mutagen (RPG) (Demo) (Game Development) (Technical Art) (VFX)