Developer Center | Auki

Welcome to the developer center

Physical AI is form-factor agnostic. Give spatial intelligence to robots, smart glasses, phones, or any other machine. A blue ocean of opportunities awaits on the real world web.

Join the Discord Visit us in HK



Robotics

Connecting your robots to the real world web makes new physical spaces instantly accessible to them.](/content/developers/welcome#/index.html)



Glasses & Wearables

When smart glasses and "whereables" know where they are, they can become AI copilots for the real world.](/content/developers/welcome#/index.html)



Phones

Your phone is basically a robot without limbs. It can also be an AI copilot, or a platform for rich XR experiences.](/content/developers/welcome#/index.html)

Want to build for robots or glasses but don’t have your own?

We've got you covered at the HK Hacker House.

Explore content

These open source codebases and tutorials will help get you started.

Real World Web Robotics Glasses Phones



Intermediate

Web-based domain viewer

Explore your domain with this web-based 3D visualization tool that displays point cloud data, navigation and occlusion meshes, and portals. Use our demo or deploy it yourself.](/content/developers/content/topic/content/web-based-domain-viewer/index.html)



Foundational

Introduction to domain setup

Get started with domains by setting one up in a few easy steps. All you need are some portal QR codes and a phone running iOS 16+ or Android 13+.](/content/developers/content/topic/content/introduction-to-domain-setup/index.html)



Beginner

Adding navigation and occlusion meshes

Add walkable areas and occlusion volumes to your domain. These help give your devices an understanding of the space.](/content/developers/content/topic/content/adding-navigation-and-occlusion-meshes/index.html)



Beginner

Bring your computer vision to the Real World Web

A quick start guide on how to make your computer vision detect things in 3D instead of 2D.](/content/developers/content/topic/content/bring-your-computer-vision-to-the-real-world-web/index.html)



Beginner

Map utils for robots

Explore these python scripts for map extraction from your real world web domain, raycasting, navigation, and route optimization.](/content/developers/content/topic/content/map-utils-for-robots/index.html)



Intermediate

ROS2 for Unitree G1

This repository contains ROS2 packages and instructions specifically tailored for the Unitree G1 Humanoid robot.](/content/developers/content/topic/content/ros2-for-unitree-g1/index.html)



Intermediate

Robotics for Cactus

This project provides Python and C++ implementations of the Cactus API client, allowing your robot to perform product search and position retrieval in a retail store running Cactus.](/content/developers/content/topic/content/robotics-for-cactus/index.html)



Beginner

Bring your robot to the Real World Web

A quick start guide on how to make the physical world more accessible to your robot.](/content/developers/content/topic/content/bring-your-robot-to-the-real-world-web/index.html)



Beginner

Positioning for glasses

Send an image from your glasses to Auki's VPS and instantly get the position of the glasses inside a real world web domain.](/content/developers/content/topic/content/positioning-for-glasses/index.html)



Intermediate

Orchestration with robots

Collaborating with robots is much more powerful when the glasses you wear can communicate spatial information to your robots.](/content/developers/content/topic/content/orchestration-with-robots/index.html)



Experienced

AI copilot for physical work

Mika has open sourced oneshot, an AI copilot that guides users through procedures using computer vision analysis.](/content/developers/content/topic/content/ai-copilot-for-physical-work/index.html)



Experienced

Mentra Live + Auki CV

This real-time computer vision application for Mentra smart glasses captures images, stores them in an Auki domain, and analyzes them using an Auki CV node.](/content/developers/content/topic/content/mentra-live-auki-cv/index.html)



Foundational

Unity SDK quickstart guide

Our Unity SDK allows you to create rich AR experiences on the real world web. Setting up your development environment is easy and only takes a few minutes.](/content/developers/content/topic/content/unity-sdk-quickstart-guide/index.html)



Beginner

Create a simple shared AR experience

This tutorial goes through how to use our ConjureKit Unity SDK to create a shared AR app from scratch.](/content/developers/content/topic/content/create-a-simple-shared-ar-experience/index.html)



Beginner

Create a simple persistent AR experience

When you can persist digital information in its correct physical context, it unlocks a rich digital layer on top of your physical space.](/content/developers/content/topic/content/create-a-simple-persistent-ar-experience/index.html)



Experienced

Multiplayer AR games

Welcome to the world of Ghosts 'n Pumpkins! In this tutorial, we'll show you how to convert a single-player Unity AR game into a multiplayer game using the Auki SDK.](/content/developers/content/topic/content/multiplayer-ar-games/index.html)

What's being built already?

Looking for some inspiration? Check out what others are already building on the real world web.

Robot navigation Orchestration Spatial analytics AI copilots AR navigation Immersive XR AR games Autonomous drones

Robotics

Autonomous navigation

This is the world's first live demo of large-scale autonomous humanoid robot navigation. We brought Terri, our Unitree G1, to a venue he had never been to before. After connecting to that venue's real world web domain, he could navigate autonomously to any booth at the conference.

Connecting a robot to the real-world web - YouTube

Tap to unmute

Connecting a robot to the real-world web Auki - Building the real world web

Auki - Building the real world web3.73K subscribers

Robotics, Glasses

Spatial orchestration

Live demo on a community update of app-agnostic, device-agnostic spatial orchestration between smart glasses, two different robots, and a computer.

Spatial orchestration on the real world web - YouTube

Tap to unmute

Spatial orchestration on the real world web Auki - Building the real world web

Auki - Building the real world web3.73K subscribers

Phones, Glasses, Robotics

Cactus

Designed for the hybrid human and robotic workforce of the future, Cactus gives retail enterprise access to a whole new dimension of spatial analytics and tools.

Cactus for retail - YouTube

Tap to unmute

Cactus for retail Auki - Building the real world web

Auki - Building the real world web3.73K subscribers

Glasses

Oneshot AI

Built by grant recipient Mika Haak, oneshot is an AI copilot running on Mentra Live glasses and the real world web. It stores the procedural memory of a place and detects mistakes in real time.

Oneshot: AI copilot for physical work - YouTube

Tap to unmute

Oneshot: AI copilot for physical work Auki - Building the real world web

Auki - Building the real world web3.73K subscribers

Phones

Gotu

We partnered with Zappar, combining our indoor navigation app with their accessible QR codes and app clips to build app-free navigation with audio cues for the blind and low vision community.

App-free indoor navigation at AWE 2025 - YouTube

Tap to unmute

App-free indoor navigation at AWE 2025 Auki - Building the real world web

Auki - Building the real world web3.73K subscribers

Phones

McKenna

The McKenna app (now also app-free thanks to our partnership with Zappar) turns your physical space into an augmented reality canvas, where you and friends can see the same vivid overlay on the world.

Introducing McKenna - YouTube

Tap to unmute

Introducing McKenna Auki - Building the real world web

Auki - Building the real world web3.73K subscribers

Phones

Floorcraft

Floorcraft: Blasters is a shared augmented reality game powered by the real world web. It uses our relay network which provides ultra low latency for multiplayer AR sessions — a necessity when you're mid battle!

Play for it? - YouTube

Tap to unmute

Play for it? Auki - Building the real world web

Auki - Building the real world web3.73K subscribers

Drones

Alpha AI

Hong Kong is the most vertical city in the world, and Alpha AI is pioneering the low altitude economy with autonomous drone inspections of skyscrapers as well as drone deliveries between islands. They're using the real world web for mapping and positioning.

Alpha AI: Autonomous drone inspections and deliveries - YouTube

Tap to unmute

Alpha AI: Autonomous drone inspections and deliveries Auki - Building the real world web

Auki - Building the real world web3.73K subscribers

HK Hacker House

Don’t have robots or smart glasses? We do. Come to Hong Kong.

We offer grants, hacker residencies right next to the hardware capital of the world, and the chance to hang out with us as well as other cool people we share space with: Dimensional, Alpha AI, Rice Robotics, and Alset Robot.

Mika Haak VLOG: building oneshot AI at the HK Hacker House - YouTube

Tap to unmute

Mika Haak VLOG: building oneshot AI at the HK Hacker House Auki - Building the real world web

Auki - Building the real world web3.73K subscribers

Available hardware

Fun toys you can get your hands on:

Robotics

Glasses & wearables

Compute

Let us know if you have your heart set on specific hardware not listed above. If enough people want something, we may try to source it.

Apply for a grant or residency

Hardware partners

Dear hardware manufacturers:

Your hardware is great, but it needs better software to be useful. Developers will make it both useful and deployable.

We are accepting hardware donations and loans for the HK Hacker House.

In return, we’ll integrate it with the real world web, publish open source packages, and even write documentation for it. And of course, we'll have developers build on it.

Have something lying around or want to sponsor a developer? Contact us.

PadBot onboarding in under 2 minutes - YouTube

Tap to unmute

PadBot onboarding in under 2 minutes Auki - Building the real world web

Auki - Building the real world web3.73K subscribers