Tobiko Fish

Ojingo Labs

Unreal 5 work in progress project

Current feature implemented

  • Fish navigation using custom waypoint system ( no AI node ).

  • Widget for UI action button.

  • Procedural animation and head gesture for fish swim and action using Unreal control rig system.

  • Vocal command from iPhone app using gRPC system.

  • Environment setup using store asset from FAB.

  • State tree to handle fish action for navigation and action.

  • Fish expression using morph target.

This project is targeting device like Jetson, and build for Linux arm 64 platform.
Also implemented feature is Vision LLM system, so the fish based on some action from camera respond to it as well, this is using websocket.

Current work in progress video for this fish tank like app.

Example using gRPC from iPhone app to command some action to the fish

Example using gRPC from iPhone App to ask fish something

Next
Next

Empires & Interconnections - 2023