All guides

How to Build an AI 3D Game Prototype with Generated Assets and Worlds

Build an AI 3D game prototype by combining generated props and worlds with collision, controls, interaction, and a tested Unity or Unreal export path.

How to Build an AI 3D Game Prototype with Generated Assets and Worlds guide cover

Direct answer

Build an AI 3D game prototype by defining one playable loop, generating only the assets and environment needed for that loop, importing them into Unity or Unreal, then adding collision, controls, triggers, feedback, and a measurable performance budget.

Takeaways

  • A prototype proves a player loop, not the maximum visual quality of a generation model.
  • Use object generators for props and characters, world generators for scene layers, and the engine for gameplay state, physics, navigation, and UI.
  • Validate one end-to-end asset before generating a library; conversion and cleanup costs can erase the speed gained during generation.
A practical AI 3D game prototype stack
Prototype needSuggested laneOutputEngine work still required
Props or pickupsTripo, Meshy, Rodin, Hunyuan3DGLB or provider-native FBXScale, pivot, collision, materials, LOD
Explorable visual worldMarble or Hunyuan WorldMesh, splat, or world packageCollision, navigation, lighting, optimization
Fast environment shellSkybox AIPanorama, cubemap, or GLBCamera limits and foreground geometry
Playable loopUnity or UnrealProject buildControls, state, goals, failure, feedback

Output formats

Choose the file your next tool can use.

File extensions do not guarantee identical contents. Check whether the result is a mesh, a Gaussian-splat scene, or a provider-specific package before importing it.
SPZ

SPZ

SPZ stores compressed 3D Gaussian splats rather than a conventional polygon mesh. It retains splat attributes such as position, scale, rotation, opacity, color, and spherical harmonics while reducing file size. Use an SPZ-compatible splat viewer and confirm coordinate-system handling before moving the scene between tools.

Best for
Compact Gaussian-splat worlds, web viewers, and real-time scene delivery.
Open with
Open it in an SPZ-compatible Gaussian-splat viewer or runtime. Niantic's browser-based SPZ Tools can inspect metadata and convert between SPZ and compatible PLY splat files without installing an application.
How to use
Keep SPZ as the compact delivery copy when the target viewer supports it. Import it through that viewer's SPZ loader, or convert a working copy to PLY when an editor needs a less compressed interchange format.
Check first
Confirm the SPZ version, point count, spherical-harmonic detail, coordinate system, orientation, scale, and visual quality after decompression. Do not treat it as a polygon mesh.
SOG

SOG

SOG means Spatially Ordered Gaussians. It is a lossy, compact container made from a metadata file and compressed image data that stores the properties of a Gaussian-splat scene. Treat the download as a file set and keep its files together when hosting or importing it.

Best for
PlayCanvas, browser delivery, and streaming Gaussian-splat scenes.
Open with
Preview it with the PlayCanvas Viewer or another runtime that explicitly supports SOG. SOG is a dataset made from meta.json plus compressed image files, not a single conventional 3D model.
How to use
Extract the complete download when needed, preserve every companion filename and relative path, then load meta.json through the compatible viewer or host the entire file set together for streaming.
Check first
Check that no metadata or image file is missing, that the server returns the correct files, and that color, opacity, orientation, scale, and compression quality match the source scene.
PLY

PLY

PLY is an openly documented format for vertices and optional polygon faces with custom per-element properties. In a world-generation workflow, a PLY may contain Gaussian-splat point attributes rather than a ready-made triangle mesh. Inspect the header and use a compatible splat tool before assuming it will behave like an OBJ or GLB.

Best for
Splat editing, research tools, point-cloud exchange, and conversion workflows.
Open with
Open a Gaussian-splat PLY in a splat-aware editor or viewer such as SuperSplat. A general PLY importer may read the points but ignore the custom opacity, scale, rotation, and spherical-harmonic properties.
How to use
Use PLY as an editable or conversion-oriented copy of the splat scene. Import it into the intended splat tool, make or validate changes there, then export the delivery format required by the final viewer.
Check first
Inspect the PLY header before choosing a tool. Confirm whether it contains polygon faces, a basic point cloud, or Gaussian-splat attributes, then check point count, axes, scale, color, and opacity.
DRC

DRC

DRC is a raw file compressed with Google Draco, a library for meshes and point clouds. It is optimized for storage and transmission, but it is not a complete scene package by itself: materials, textures, cameras, and other world data may be delivered separately or omitted.

Best for
Compact geometry transfer and pipelines that already include a Draco decoder.
Open with
Decode it with Google's Draco decoder or open it through a 3D pipeline that explicitly supports raw DRC geometry. Most desktop viewers cannot use a standalone DRC file by double-clicking it.
How to use
Decode or transcode the geometry into the format expected by the next tool, then reconnect any separately delivered materials, textures, cameras, or scene data. Keep the original DRC as the compressed source copy.
Check first
Verify whether the decoded result is a mesh or point cloud and confirm positions, normals, texture coordinates, color attributes, scale, and orientation. DRC alone is not a complete rendered world.
WORLD

WORLD

WORLD labels the primary scene file returned by the Hunyuan World provider; it is not a universal interchange standard like glTF. Preserve the original filename and any companion files, then use the provider's documented workflow or convert the result before opening it in a general 3D tool.

Best for
Keeping the provider-native Hunyuan World result for its supported workflow.
Open with
Use the Hunyuan World workflow or runtime documented for the generated package. General-purpose 3D applications should not be expected to recognize a provider-native WORLD file directly.
How to use
Preserve the original filename, folder structure, and every companion asset. Start from the provider's loader or conversion path, and create a separate GLB, DRC, or other working copy only when that workflow supports it.
Check first
Confirm the provider version, required runtime, companion files, coordinate system, scene scale, licensing, and conversion limitations before depending on the package outside its native workflow.
GLB

GLB

A world GLB uses the same binary glTF container as an object GLB, but the contents can be very different: it may be an environment mesh, depth mesh, or a provider-specific scene export. It does not automatically preserve the view-dependent appearance or navigational behavior of a Gaussian-splat world.

Best for
Mesh-based web previews, common 3D applications, and engine import.
Open with
Preview it in World Models Watch or a glTF viewer, edit it with Blender's glTF 2.0 importer, or import it into a compatible Unity, Unreal Engine, Godot, or web 3D workflow.
How to use
Treat it as a mesh-based environment export. Import one copy into the destination, then configure materials, lighting, collision, navigation, cameras, and performance settings required by that project.
Check first
Check scale, axes, normals, material extensions, texture color, holes, collision suitability, polygon cost, and whether the scene is only a depth shell. A world GLB is not automatically a navigable splat world.

Scope the loop

Write the playable sentence before generating anything.

A useful scope sounds like: walk through one room, find three parts, repair a device, and exit before the timer ends. That sentence identifies the environment, interactive props, player controller, game state, and feedback required. It also prevents a prototype from turning into an uncontrolled asset-generation exercise.

Choose a visual target and a performance target. Decide platform, camera, expected session length, input method, and whether the prototype must run on web, desktop, mobile, or XR. Generate temporary assets only after those constraints exist.

Assemble

Keep visual generation and gameplay implementation separate.

Import one object first and fix units, orientation, pivot, textures, and collision. Then import the environment and decide whether it is background, visual geometry, or editable level structure. Gaussian splats need a compatible renderer; skyboxes remain background shells; generated meshes may require separate simplified collision.

Add a controller, spawn point, one interaction, a goal state, and a failure or reset path before polishing. Use primitive colliders and placeholder UI where they make iteration faster. The generated world supplies appearance, while the engine owns deterministic rules and player feedback.

Test the build

Measure whether generation accelerated the prototype.

Run the complete loop with someone who did not build it. Watch where they get stuck, where collision fails, and whether generated detail obscures interactive objects. Record import time, cleanup time, frame rate, memory, file size, and the number of manual fixes needed per asset.

Replace only the assets that block the test. If a generated environment is expensive or difficult to navigate, keep it as a distant visual layer and rebuild the playable path with simple geometry. The prototype succeeds when it answers a design question quickly, not when every surface is final art.

FAQ

Can an AI world generator create a playable game prototype?

It can create visual assets or an explorable scene, but the engine still needs controls, collision, state, objectives, interaction, UI, and performance work.

Should a prototype use generated worlds or generated props first?

Start with the element that tests the core loop. Use generated props for object-centered mechanics and a generated world for spatial mood or navigation, but validate one complete import path before scaling.

Decision tables

Use a comparison when two lanes are still competing.

Sources

Discussion

Reader discussion

Add source-backed corrections, questions, or notes for this page.

Loading comments
Loading discussion...

Loading comments...