All guides

AI Spatial Storytelling: Build and Export Interactive 3D Scenes

Use AI spatial storytelling to build interactive 3D scenes, choose a world model, and export a shareable world, XR experience, or recorded story.

AI Spatial Storytelling: Build and Export Interactive 3D Scenes guide cover

Direct answer

AI spatial storytelling works best when generation supplies places and atmosphere while the creator designs viewpoint, sequence, interaction, audio, and pacing; export the result as a hosted world, XR scene, engine asset, panorama, or recorded video according to the audience.

Takeaways

  • Marble fits persistent composed worlds; Skybox AI fits 360 atmosphere; Echo and SpatialGen fit visual splat scenes.
  • A spatial scene does not contain a story automatically. The narrative still needs a route, reveal order, cues, events, and an ending condition.
  • Choose the delivery format before authoring: a share link, VR visit, engine scene, and linear MP4 require different levels of interaction and optimization.
Choose a world model for spatial storytelling
Story formatSuggested model laneDeliveryCreative constraint
Persistent explorable placeMarbleShare link, VR, GLB, SPZ, or PLYDesign the route and interaction separately
360 atmospheric sceneSkybox AIPanorama, cubemap, video, or available GLBLimited close-range parallax and geometry
Photographic spatial vignetteEcho or SpatialGenSPZ, SOG, or PLYNeeds a compatible splat viewer
Linear story captureAny validated worldMP4 recordingCamera, edit, audio, and captions carry the sequence

Output formats

Choose the file your next tool can use.

File extensions do not guarantee identical contents. Check whether the result is a mesh, a Gaussian-splat scene, or a provider-specific package before importing it.
SPZ

SPZ

SPZ stores compressed 3D Gaussian splats rather than a conventional polygon mesh. It retains splat attributes such as position, scale, rotation, opacity, color, and spherical harmonics while reducing file size. Use an SPZ-compatible splat viewer and confirm coordinate-system handling before moving the scene between tools.

Best for
Compact Gaussian-splat worlds, web viewers, and real-time scene delivery.
Open with
Open it in an SPZ-compatible Gaussian-splat viewer or runtime. Niantic's browser-based SPZ Tools can inspect metadata and convert between SPZ and compatible PLY splat files without installing an application.
How to use
Keep SPZ as the compact delivery copy when the target viewer supports it. Import it through that viewer's SPZ loader, or convert a working copy to PLY when an editor needs a less compressed interchange format.
Check first
Confirm the SPZ version, point count, spherical-harmonic detail, coordinate system, orientation, scale, and visual quality after decompression. Do not treat it as a polygon mesh.
SOG

SOG

SOG means Spatially Ordered Gaussians. It is a lossy, compact container made from a metadata file and compressed image data that stores the properties of a Gaussian-splat scene. Treat the download as a file set and keep its files together when hosting or importing it.

Best for
PlayCanvas, browser delivery, and streaming Gaussian-splat scenes.
Open with
Preview it with the PlayCanvas Viewer or another runtime that explicitly supports SOG. SOG is a dataset made from meta.json plus compressed image files, not a single conventional 3D model.
How to use
Extract the complete download when needed, preserve every companion filename and relative path, then load meta.json through the compatible viewer or host the entire file set together for streaming.
Check first
Check that no metadata or image file is missing, that the server returns the correct files, and that color, opacity, orientation, scale, and compression quality match the source scene.
PLY

PLY

PLY is an openly documented format for vertices and optional polygon faces with custom per-element properties. In a world-generation workflow, a PLY may contain Gaussian-splat point attributes rather than a ready-made triangle mesh. Inspect the header and use a compatible splat tool before assuming it will behave like an OBJ or GLB.

Best for
Splat editing, research tools, point-cloud exchange, and conversion workflows.
Open with
Open a Gaussian-splat PLY in a splat-aware editor or viewer such as SuperSplat. A general PLY importer may read the points but ignore the custom opacity, scale, rotation, and spherical-harmonic properties.
How to use
Use PLY as an editable or conversion-oriented copy of the splat scene. Import it into the intended splat tool, make or validate changes there, then export the delivery format required by the final viewer.
Check first
Inspect the PLY header before choosing a tool. Confirm whether it contains polygon faces, a basic point cloud, or Gaussian-splat attributes, then check point count, axes, scale, color, and opacity.
DRC

DRC

DRC is a raw file compressed with Google Draco, a library for meshes and point clouds. It is optimized for storage and transmission, but it is not a complete scene package by itself: materials, textures, cameras, and other world data may be delivered separately or omitted.

Best for
Compact geometry transfer and pipelines that already include a Draco decoder.
Open with
Decode it with Google's Draco decoder or open it through a 3D pipeline that explicitly supports raw DRC geometry. Most desktop viewers cannot use a standalone DRC file by double-clicking it.
How to use
Decode or transcode the geometry into the format expected by the next tool, then reconnect any separately delivered materials, textures, cameras, or scene data. Keep the original DRC as the compressed source copy.
Check first
Verify whether the decoded result is a mesh or point cloud and confirm positions, normals, texture coordinates, color attributes, scale, and orientation. DRC alone is not a complete rendered world.
WORLD

WORLD

WORLD labels the primary scene file returned by the Hunyuan World provider; it is not a universal interchange standard like glTF. Preserve the original filename and any companion files, then use the provider's documented workflow or convert the result before opening it in a general 3D tool.

Best for
Keeping the provider-native Hunyuan World result for its supported workflow.
Open with
Use the Hunyuan World workflow or runtime documented for the generated package. General-purpose 3D applications should not be expected to recognize a provider-native WORLD file directly.
How to use
Preserve the original filename, folder structure, and every companion asset. Start from the provider's loader or conversion path, and create a separate GLB, DRC, or other working copy only when that workflow supports it.
Check first
Confirm the provider version, required runtime, companion files, coordinate system, scene scale, licensing, and conversion limitations before depending on the package outside its native workflow.
GLB

GLB

A world GLB uses the same binary glTF container as an object GLB, but the contents can be very different: it may be an environment mesh, depth mesh, or a provider-specific scene export. It does not automatically preserve the view-dependent appearance or navigational behavior of a Gaussian-splat world.

Best for
Mesh-based web previews, common 3D applications, and engine import.
Open with
Preview it in World Models Watch or a glTF viewer, edit it with Blender's glTF 2.0 importer, or import it into a compatible Unity, Unreal Engine, Godot, or web 3D workflow.
How to use
Treat it as a mesh-based environment export. Import one copy into the destination, then configure materials, lighting, collision, navigation, cameras, and performance settings required by that project.
Check first
Check scale, axes, normals, material extensions, texture color, holes, collision suitability, polygon cost, and whether the scene is only a depth shell. A world GLB is not automatically a navigable splat world.

Design the story

Start with a route of discoveries, not a visual prompt.

Write three beats: what the visitor sees on arrival, what changes their understanding, and where the experience resolves. Give each beat a location, landmark, sound, text fragment, object, or interaction. This creates an authoring checklist before the world generator introduces attractive but narratively irrelevant detail.

Use Marble when the place must persist, be composed, shared, or visited in VR. Use Skybox AI when the story needs a fast surrounding atmosphere or distant world. Echo and SpatialGen suit photographic spatial vignettes where splat rendering is acceptable. Genie and Odyssey may inspire emergent interaction, but do not plan a durable export around them without current documentation.

Author the experience

Use space to control attention and sequence.

Place one unmistakable landmark at each story beat and keep important objects within the expected path. Use light, color contrast, sound direction, scale, and occlusion to pull the visitor forward. Offer a reset or orientation cue so exploration does not become confusion.

Generated geometry can support mood but may contain dead ends, warped surfaces, or distracting detail. Test the world without narration first. If visitors cannot find the next beat, simplify the route, add a cue, or constrain movement rather than adding more explanatory text.

Deliver

Export the smallest format that preserves the story.

Use a hosted link for immediate access, a VR link when embodiment is essential, GLB for a mesh-based engine workflow, and SPZ or PLY for a compatible splat runtime. Use panorama or cubemap exports for fixed-view immersive scenes. Record MP4 when the audience needs a guided, linear version without installing a viewer.

Before publishing, test loading, camera height, motion comfort, navigation, audio levels, captions, and the ending state. Keep a fallback video or image sequence for devices that cannot render the interactive world. The export is successful when the intended audience can reach every story beat without production guidance.

FAQ

What is AI spatial storytelling?

It is a workflow where generated models or worlds supply visual space while a creator designs the narrative route, timing, interaction, audio, text, and audience experience.

Do I need a game engine for a spatial story?

Not always. A hosted world, VR link, panorama, or recorded video may be enough. Use Unity or Unreal when the story needs custom interaction, state, UI, physics, or distribution.

Decision tables

Use a comparison when two lanes are still competing.

Sources

Discussion

Reader discussion

Add source-backed corrections, questions, or notes for this page.

Loading comments
Loading discussion...

Loading comments...