Scans of the world from Pokemon Go and Ingress are the backbone of Niantic’s AI model, which aims to navigate the world like ChatGPT spits out text.
Share this story
Niantic has announced that it’s building a new “Large Geospatial Model” (LGM) that combines millions of scans taken from the smartphones of players of Pokémon Go and other Niantic products. This AI model could allow computers and robots to understand and interact with the world in new ways, the company said in a blog post spotted by Garbage Day.
The LGM’s “spatial intelligence” is built on the neural networks developed as part of Niantic’s Visual Positioning System. The blog post explains that “Over the past five years, Niantic has focused on building our Visual Positioning System (VPS), which uses a single image from a phone to determine its position and orientation using a 3D map built from people scanning interesting locations in our games and Scaniverse,” and “This data is unique because it is taken from a pedestrian perspective and includes places inaccessible to cars.”
Niantic Chief Scientist Victor Prisacariu was more explicit in a 2022 Q&A, saying, “Using the data our users upload when playing games like Ingress and Pokémon Go, we built high-fidelity 3D maps of the world, which include both 3D geometry (or the shape of things) and semantic understanding (what stuff in the map is, such as the ground, sky, trees, etc).”
As 404 Media points out, nobody who downloaded Pokémon Go in 2016 could have predicted their data would “one day fuel this type of AI product.”
