WO2025094018A1

WO2025094018A1 - Augmented reality real estate mobile application for existing and future properties

Info

Publication number: WO2025094018A1
Application number: PCT/IB2024/060571
Authority: WO
Inventors: Maryam AL DOORI
Original assignee: Individual
Current assignee: Individual
Priority date: 2023-10-30
Filing date: 2024-10-27
Publication date: 2025-05-08
Anticipated expiration: 2026-04-30

Abstract

The present invention relates to an augmented reality-based system for real estate exploration and property management, comprising a mobile application, a cloud-based server, a web-based platform and a content management system (CMS). The mobile application, utilizing an AR engine, overlays property data, virtual tours, Al-staged interiors, and 3D models onto the camera feed of a smart device based on geolocation and orientation.

Description

AUGMENTED REALITY REAL ESTATE MOBILE APPLICATION FOR EXISTING

AND FUTURE PROPERTIES

FIELD OF THE INVENTION

The present invention relates to the fields of mobile applications, augmented reality (AR), and real estate technology. Specifically, it addresses the need for an enhanced property exploration experience using AR in mobile applications, allowing users to interact with real estate data in both current and future real-world environments.

BACKGROUND TO THE INVENTION

The real estate industry has traditionally relied on static images, floor plans, and virtual tours to help prospective buyers, renters, and investors explore properties. While these tools have helped to bridge the gap between physical and digital property exploration, they often require users to manually search for property addresses and navigate through multiple steps or “clicks” to access relevant information. This layered navigation, requiring several interactions to locate details on a single property, can slow down the search process, detracting from the user experience. Such inefficiencies become particularly burdensome for users seeking a quick, streamlined experience without excessive clicks or manual address lookups.

The inability to visualize spaces in real time based on individual preferences, or to experience future buildings or newly planned projects directly on-site, limits the prospective buyer’s ability to understand the full potential of a property. For developments under construction or conceptual projects, traditional methods fall short in providing an immersive view of the final product’s integration into its surroundings. Moreover, existing tools frequently lack the dynamic flexibility to incorporate Al staging, which can provide buyers with customized visualizations of potential furnishings and layouts.

The need to physically visit properties to gain a true understanding of their layout, surroundings, and potential can be both time-consuming and impractical, particularly when buyers are located far from the property or when a property is under development and not yet built. This issue is especially pronounced in markets where future developments are sold based on floor plans and digital mock-ups, making it difficult for potential buyers to visualize the final product in its real-world environment.

OBJECT OF THE INVENTION

It is accordingly an object of the present invention to provide an augmented reality real estate mobile application for existing and future properties with which the applicant believes the above-mentioned disadvantages would at least partially be addressed or which would provide a useful alternative to known real estate mobile applications.

SUMMARY OF THE INVENTION

According to a first aspect of the present invention, there is provided a system for augmented reality-based real estate exploration and property management, comprising: a mobile application, configured to run on a smart device with a camera and geolocation capabilities, the mobile application comprising: o an augmented reality (AR) interface that dynamically overlays property- related data onto a live camera feed of the smart device, wherein the property-related data includes property information and visual elements rendered in real-time based on the smart device’s geolocation and camera orientation; o a geolocation module configured to determine the location of the smart device; o a data request module configured to send property-related requests to a cloud-based server based on the geolocation and camera orientation of the smart device; and o a user interaction module configured to allow a user to select and view additional property details, virtual tours, and three-dimensional models of properties through the AR interface; a web-based platform, accessible by administrators via a web-based interface, the web-based platform comprising: o an interface for managing property data, including creating, updating, and deleting property listings, which is communicated to the cloud-based server; and o an interface for uploading and managing media content, including property images, videos, and three-dimensional models, wherein the media content is communicated to a content management system (CMS) for storage and retrieval; a cloud-based server, communicatively coupled with the mobile application and the web-based platform, the cloud-based server comprising: o a main application programming interface (API) configured to receive data request from the mobile application and the web-based platform; o a property database configured to store structured property data, including property location, price, and attributes; and o an integration service configured to retrieve up-to-date property data from external real estate listing services; and a headless content management system (CMS) commutatively coupled to the cloud-based server, configured to: o store and manage unstructured media content related to properties, including images, videos, and three-dimensional models; and o provide media content dynamically to the mobile application and webbased platform via API connections, wherein the mobile application, upon receiving a user’s geolocation and camera orientation, retrieves property data from the cloud-based server and displays the property data dynamically via augmented reality projections on the smart device’s display, and wherein the web-based platform allows administrators to manage and update property data and upload media content, including three-dimensional models and images, to the content management system, and wherein the mobile application dynamically retrieves these updates from the cloud-based server, which, in turn, fetches the media content from the content management system as needed.

The augmented reality interface may be configured to display property visual markers (for example, icons or pins) and three-dimensional models of current and/or preconstruction properties at varying scales, based on the distance between the smart device and the respective property (that is, existing or preconstruction properties), so that properties (that is, existing or preconstruction properties) closer to the user appear larger and those farther away appear smaller.

The geolocation module may be configured to track changes in the user’s location in real time, and the mobile application automatically updates the property data and augmented reality projections as the user moves within a geographic area.

The integration service within the cloud-based server may be configured to retrieve real-time property data from multiple real estate listing services, including but not limited to multiple listing services (MLS) and internet data exchange (IDX), to ensure that property listings are current and accurate.

The content management system (CMS) may be further configured to store three- dimensional models of existing and preconstruction properties, and the mobile application may render these models in the augmented reality interface at the exact location where the building is or will be constructed, using real-world coordinates provided by the geolocation module. The cloud-based server may be further communicatively coupled with: geolocation and mapping services to retrieve geolocation data, imagery of properties and/or surroundings, route guidance, and nearby points of interest, which are displayed dynamically alongside the augmented reality projections; and/or payment gateways for secure payment processing within the mobile application, enabling users to purchase additional features for the mobile application; and/or authentication services for allowing users to log into the mobile application using their social media or electronic mail accounts; and/or messaging services for sending electronic mail notifications and push notifications to the users; and/or an advertisement service for incorporating advertisements based on the user’s geolocation into the augmented reality projections.

According to a second aspect of the present invention, there is provided a computer- implemented method for augmented reality-based real estate exploration and property management, comprising: launching a mobile application on a smart device, wherein the mobile application includes an augmented reality interface and a geolocation module; capturing geolocation data and camera orientation from the smart device; sending a data request from the mobile application to a cloud-based server, the request including the captured geolocation data and camera orientation; retrieving property data from the cloud-based server, the property data including structured property information from a property database and unstructured media content from a content management system; overlaying the retrieved property data dynamically onto a live camera feed within the augmented reality interface of the mobile application, wherein property visual markers and three-dimensional models are displayed based on the user’s geolocation and camera orientation; allowing the user to interact with the augmented reality interface, enabling the selection of property visual markers to view additional property details, virtual tours, or three-dimensional models; and receiving updated property data in real-time from the cloud-based server as the user’s geolocation or camera orientation changes.

The computer-implemented method may further comprise scaling the property visual markers and three-dimensional models displayed in the augmented reality interface based on the distance between the smart device and the respective property, such that properties closer to the user appear larger and those farther away appear smaller. The computer-implemented method may further comprise tracking the user’s movement by means of the geolocation of the mobile application, and automatically updating the property data and augmented reality projections based on the user’s current location.

The computer-implemented method may further comprise retrieving real-time property data from external real estate listing services, including but not limited to multiple listing services (MLS) and internet data exchange (IDX), and displaying the retrieved data in the augmented reality interface based on the user’s geolocation and camera orientation.

The computer-implemented method may further comprise: uploading structured property information pertaining to existing and/or preconstruction properties, through a web-based platform and/or the mobile application, by an administrator and/or a real estate agent, to the property database and unstructured media content pertaining to existing and/or preconstructions properties to the content management system (CMS) for storage and retrieval by the cloud-based server as needed.

It will be appreciated by the person skilled in the art that the step of uploading structured and/or unstructured property information may ensure that user’s have access to up-to-date property details stored on the multi listing services (MLS), the internet data exchange (IDX), the main database, and the content management system (CMS). This ensures that the most up-to-date property information is rendered and displayed by the augmented reality (AR) interface, in response to the geolocation of the user.

The computer-implemented method may further comprise rendering three- dimensional models of existing or preconstruction properties in the augmented reality interface, the computer-implemented method further comprising rendering three- dimensional model data from the content management system and rendering the models at the correct real-world location based on geolocation data provided by the mobile application. The computer-implemented method may further comprise: retrieving geolocation data, imagery of properties and their surroundings, route guidance, and nearby points of interest for display alongside the augmented reality projections by communicatively coupling the cloud-based server to a geolocation and mapping service; and/or enabling users to purchase additional features for the mobile application by communicatively coupling the cloud-based server with a payment gateway; and/or allowing users to log into the mobile application using their social media or electronic mail accounts by communicatively coupling the cloud-based server with an authentication service; and/or sending electronic mail and push notifications to the user by communicatively coupling the cloud-based server to a messaging service; and/or incorporating advertisements into the augmented reality interface based on the user’s geolocation by communicatively coupling the cloud-based server to an advertisement service.

"The term “and/or” as used in this specification means that either one or all of the listed elements may be included. Specifically, “A and/or B” refers to A alone, B alone, or both A and B together.

BRIEF DESCRIPTION OF THE ACCOMPANYING DRAWING

The invention will now be described further, with reference to the accompanying drawing wherein: Figure 1 is a diagrammatic block diagram of a system for augmented realitybased real estate exploration and property management according to the present invention.

DETAILED DESCRIPTION OF THE INVENTION

With reference to the accompanying drawing, in which like features are indicated by like numerals, a system for augmented reality-based real estate exploration and property management is generally indicated by reference numeral 1000. The flow of data within the system 1000 and to or from external services 50A, 50B, 60, 70, 80, 90, 100, and 110 are indicated by arrows. Broken arrows in the drawing indicates interaction (for example, a user 12A or 12B interacting with a mobile application 10A or 10B.

The system for augmented reality-based real estate exploration and property management 1000 comprises: a mobile application 10A or 10B, configured to run on a smart device (not shown) with a camera (not shown) and geolocation capabilities, the mobile application 10A or 10B comprising: o an augmented reality (AR) interface that dynamically overlays property- related data onto a live camera feed of the smart device, wherein the property-related data includes property information and visual elements rendered in real-time based on the smart device’s geolocation and camera orientation; o a geolocation module (not shown) configured to determine the location of the smart device; o a data request module (not shown) configured to send property-related request to a cloud-based server 30 based on the geolocation and camera orientation of the smart device; and o a user interaction module (not shown) configured to allow a user 12A or 12B to select and view additional property details, virtual tours, and three-dimensional models of properties through the augmented reality interface; a web-based platform 20, accessible by administrators 22 via a web-based interface (not shown), the web-based platform 20 comprising: o an interface (not shown) for managing property data, including creating, updating, and deleting property listings, which is communicated to the cloud-based server 30; and o an interface (not shown) for uploading and managing media content, including property images, videos, and three-dimensional models, wherein the media content is communicated to a content management system (CMS) 40 for storage and retrieval; a cloud-based server 30, communicatively coupled with the mobile application 10A or 10B and the web-based platform 20, the cloud-based server 30 comprising: o a main application programming interface (API) 32 configured to receive data requests from the mobile application 10A or 10B and the web-based platform 20; o a property database 34 configured to store structured property data, including property location, price, and attributes; o an integration service 36 configured to retrieve up-to-date property data from external real estate listing services, including multi listing services (MLS) 50A and internet data exchange (IDX) 50B; and a headless content management service (CMS) 40 communicatively coupled to the cloud-based server 30, configured to: o store and manage unstructured media content related to properties, including images, videos, and three-dimensional models; and o provide media content dynamically to the mobile application 10A or 10B and web-based platform 20 via application programming interface (API) connections, wherein the mobile application 10A or 10B, upon receiving a user’s 12A or 12B geolocation and camera orientation, retrieves property data from the cloud-based server 30 and displays the property data dynamically via augmented reality projections on the smart device’s display, and wherein the web-based platform 20 allows administrators 22 to manage and update property data and upload media content, including three-dimensional models and images, to the content management system 40, and wherein the mobile application 10A or 10B dynamically retrieves these updates from the cloud-based server 30, which, in turn, fetches the media content from the content management system 40 as needed.

The system 1000 enables users 12A or 12B to explore properties by overlaying three- dimensional models of existing or preconstruction properties onto a real-world environment through augmented reality (AR). This allows users 12A or 12B to view, interact with, and modify property details in real-time. It will be appreciated that several users may interact simultaneously with the system 1000.

The system 1000 also integrates with multiple external systems, including property databases 50A and/or 50B, cloud-based storage 60, geolocation and mapping services 70 (including but not limited to Google Maps, Apple Maps, Google Street View, and OpenStreetView), payment gateways 80, authenticator services 90, an advertisement integration module 100, and messaging services 110, ensuring a seamless, interactive, and immersive real estate experience.

The mobile application 10A or 10B, which operates on iOS and Android devices (that is, smart devices), is configured to run on ARKit and ARCore platforms to deliver an immersive augmented reality (AR) experience. It provides a live augmented reality (AR) interface that overlays property visual markers (for example, icons or pins), details, imagery received from the geolocation and mapping services 70, and three- dimensional models onto the live camera feed of the smart device. The mobile application 10A or 10B integrates with the smart device’s global navigation satellite system module (for example, GPS module), camera, and orientation sensors (for example, gyroscope and/or accelerometer) to continuously track the user’s 12A or 12B position and camera direction/orientation.

When the user 12A or 12B points the smart device at a property or location, an augmented reality engine renders property markers using augmented reality (AR) anchors. These anchors are linked to GPS coordinates, allowing the mobile application 10A or 10B to accurately place virtual property visual markers (for example, icons), imagery of properties and their surroundings, and three-dimensional models on the live camera feed of the smart device. The augmented reality (AR) interface dynamically scales the size of a property icon, and a three-dimensional model of the relevant property based on the user’s 12A or 12B proximity to the property. Properties closer to the user 12A or 12B are rendered larger, while those farther away appear smaller. The augmented reality (AR) interface is further configured to display a property icon above ground zero if the relevant property is located on, for example, the third floor of a building. In this case, the augmented reality (AR) interface will display the property icon 9 metres above ground zero (that is, three levels/floors of the building times 3 metres) to give the user 12A or 12B an indication of where the relevant property is situated above a ground level.

The mobile application 10A or 10B implements the Model-View-ViewModel (MVVM) architecture, with the ViewModel layer acting as the intermediary between a user interface of the mobile application 10A or 10B and backend services. The ViewModel maintains the state of the mobile application 10A or 10B, binds data from the cloudbased server 30 to the user interface, and triggers user interface updates in real-time. For example, when the user 12A or 12B moves the camera to a new location, the ViewModel sends a new data request to the backend and updates the augmented reality (AR) projections accordingly.

The geolocation module in the mobile application 10A or 10B continuously monitors the user’s 12Aor 12B position and updates the augmented reality (AR) interface based on changes in location. When the user 12A or 12B points the camera towards a specific property or area, the mobile application 10A or 10B sends a data request to the cloud-based server 30 via the main API 32. This request contains the user’s 12A or 12B current GPS coordinates, camera orientation vector, and any active search filters, such as property type, price range, or location radius.

The cloud-based server 30 processes the request and queries the property database 34 (that is, the main database), and/or the multi listing service (MLS) 50A, and/or the internet data exchange (IDX) 50B to retrieve structured property data, including property addresses, prices, dimensions, and statuses. If the request involves additional media, such as images, videos, or three-dimensional models, the cloudbased server 30 forwards the request to the content management system (CMS) 40 to retrieve the required media files or generate external storage (for example, cloudbased storage module 60) links. The content management system (CMS) 40 returns the media content to the cloud-based server 30, which then relays it to the mobile application 10A or 10B for rendering.

To obtain imagery of the outside of a property (if existing) and/or the surrounding area of an existing or a preconstruction property for display on the augmented reality (AR) interface alongside the augmented reality (AR) projections, the cloud-based server 30 also processes requests from the mobile application 10A or 10B and integrates with external geolocation and mapping services 70, including but not limited to Google Maps, Apple Maps, Google Street View, and/or OpenStreetView. The main application programming interface (API) 32 communicates with these external services 70 to retrieve street-level imagery for properties and their surroundings, based on the geolocation of the user and camera orientation of the smart device, for display alongside or integration with property data and media content received from the main database 34, the multi listing service (MLS) 50, the internet data exchange (IDX) 50B, and/or the content management system (CMS) 40.

The augmented reality (AR) engine in the mobile application 10A or 10B processes the data received from the backend to render the corresponding augmented reality (AR) projections on the live camera feed. Using ARKit or ARCore, the mobile application 10A or 10B places augmented reality (AR) anchors in the environment based on real-world coordinates. For properties under development, the mobile application 10A or 10B retrieves three-dimensional models from the content management system (CMS) 40 and renders them at the property’s location (that is, the location where the property will be built), allowing user’s 12A or 12B to visualize the future building in its real-world setting.

The user interaction module enables the user 12A or 12B to explore these augmented reality (AR) projections interactively. Tapping on a property icon triggers a data retrieval request to the backend, which responds with additional property details such as property size, number and type of rooms, nearby points of interest, contact information, promotional offers, or agent listings. These details are displayed in a popup window or embedded view within the augmented reality (AR) interface.

For existing properties with virtual tours, the mobile application 10A or 10B retrieves panoramic images and video walkthroughs from the content management system (CMS) 40. These tours can be explored through gestures or by moving the camera, allowing the user 12A or 12B to navigate through the property directly within the augmented reality (AR) environment. The web-based platform 20 is a critical component of the system 1000, providing real estate administrators 22 with tools to manage property data and upload media content. An administrative panel of the web-based platform 20 communicates with both the cloud-based server 30 and the content management system (CMS) 40 through the main application programming interface (API) 32.

Authorized real estate agents and/or administrators 22 can use the web-based platform 20 or a mobile application which runs on their own smart device to create, update, or delete property listings in the main database 34, ensuring that all property information remains current. Any updates made through the administrative panel or the mobile application which runs on the smart device of the authorized real estate agent or administrator are immediately synchronized across the system 1000, ensuring that user’s 12A or 12B of the mobile application 10A or 10B always access the latest data. Authorized real estate agents or administrators 22 can also upload and update a catalogue or catalogues of virtual furniture pieces and/or home fittings to the main database 34 and/or the content management system (CMS) 40 for integration into the augmented reality (AR) projections. When a user 12Aor 12B views a three-dimensional model of an existing or preconstruction property, they can select specific furniture pieces and/or home fittings from the catalogue and cause them to be integrated into the augmented reality (AR) projection on the augmented reality (AR) interface. The mobile application 10A or 10B retrieves these virtual furniture pieces and home fittings from the cloud-based server 30 through the main application programming interface (API) 32. This allows the user 12A or 12B to customize a property that they are viewing. The AR engine renders virtual furniture pieces and home fittings for incorporation into the augmented reality (AR) projections. The administrative panel and mobile application which runs on a subscriber, an authorized real estate agent or administrator’s smart device also supports the upload of media content, including high-resolution images, promotional videos, and three- dimensional models of existing or preconstruction projects. The media is stored and managed by the content management system (CMS) 40, which dynamically delivers it to the mobile application 10A or 10B and web-based platform 20 as needed. Changes to property listings or media content are reflected in real time, without requiring users 12A or 12B to update the mobile application 10A or 10B.

The cloud-based server 30 acts as the backend infrastructure of the system 1000, handling data requests, processing business logic, and managing communications between the mobile application 10A or 10B, the content management system (CMS) 40, and the web-based platform 20. The cloud-based server’s 30 main application programming interface (API) 32 receives data requests from the mobile application 10A or 10B, queries the property database 34, and integrates with external real estate platforms such as multi listing services (MLS) 50A and/or internet data exchange services (IDX) 50B to retrieve up-to-date property listings.

The integration service 36 ensures that all property data remains accurate and reflects the latest changes from external real estate providers 50A or 50B. The integration service 36 retrieves property statuses, prices, and availability in real time, ensuring that users 12A or 12B have access to the most current information.

When the mobile application 10A or 10B or web-based platform 20 requests media content - such as images, three-dimensional models, or videos - the cloud-based server 30 sends an API request to the content management system (CMS) 40. The content management system (CMS) 40 returns either direct media files stored locally within the content management system (CMS) 40, or links to externally hosted files on the cloud-based storage module 60. The cloud-based server 30 processes the media request and relays the response to the mobile application 10A or 10B, ensuring realtime access to updated media content. This seamless interaction ensures users 12A or 12B have the latest visual content, such as updated three-dimensional models for existing or preconstruction properties.

The cloud-based server 30 integrates with geolocation services 70 (for example, Google Maps, Apple Maps, Google Street View, and/or OpenStreetView) and mapping services to provide accurate property positioning, imagery of properties and their surroundings, and nearby points of interest (POI). When the mobile application 10A or 10B sends GPS coordinates, the cloud-based server 30 validates and enhances the data trough mapping services. The cloud-based server 30 uses GPS data from the smart device to retrieve and align relevant property listings and imagery within a specified geographic radius. It ensures accurate placement of augmented reality (AR) anchors in the mobile application’s 10A or 10B augmented reality (AR) interface. If the user 12Aor 12B selects a property, the cloud-based server 30 provides route guidance from the user’s 12A or 12B location to the property. The system 1000 also highlights local amenities such as restaurants, schools, or shops around the selected property. This interaction allows the mobile application 10A or 10B to present real-world points of interest within the augmented reality (AR) projections, enriching the property exploration experience. The system 1000 supports in-application purchases and premium features through payment gateway 80 integrations. The cloud-based server 30 interacts with gateways such as Google Pay or Apple Pay to enable secure payments. When a user 12A or 12B initiates a payment (for example, to unlock premium property search features or access exclusive virtual tours), the mobile application 10A or 10B sends the payment request to the cloud-based server 30. The cloud-based server 30 process the request and communicates with the payment gateway 80 through API calls. After receiving confirmation from the payment gateway'80, the cloud-based server 30 updates the user’s account status and grants access to the purchased content or features. It also stores transaction details on the main database 34 for reference and audit purposes. This integration ensures that all financial transactions are secure, and users 12A or 12B can access paid services easily.

The cloud-based server 30 uses OAuth-based authentication services 90 (such as Google OAuth and Facebook login) to manage user 12A or 12B logins securely. The cloud-based server 30 handles both user registration and login request, ensuring seamless access across devices. When a user 12A or 12B logs in using an external provider, the mobile application 10A or 10B sends the login request to the cloud-based server 30. The cloud-based server 30 redirects the request to the appropriate authentication service 90 (for example, Google, Facebook, or Apple). Upon successful authentication, the cloud-based server 90 issues a secure access token to the mobile application 10A or 10B. The cloud-based server 30 stores and maintains user profiles and preferences, storing saved searches, favorite properties, and notification preferences in the main database 34. The system 1000 enhances user 12A or 12B engagement by integrating advertisements of local businesses within the augmented reality (AR) interface. The advertisement integration module 100 connects to advertisement networks (for example, Google Ads) and retrieves targeted advertisements based on the user’s 12A or 12B location and search history. When the mobile application 10A or 10B sends a geolocation request to the cloud-based server 30, the advertisement integration module identifies nearby businesses (for example, cafes, retail stores, or gyms) and retrieves relevant advertisements. These advertisements are incorporated into the augmented reality (AR) interface as promotional markers or banners overlaid on the live camera feed. For instance, if the user 12Aor 12B points the camera at a local cafe near a property, a promotional banner for that business might appear within the augmented reality (AR) interface. The advertisement integration module 100 provides an additional revenue stream for the system 1000, while also enriching the user’s 12A or 12B property exploration experience by presenting nearby businesses in the augmented reality (AR) interface.

The cloud-based server 30 also integrates with messaging services 110 (for example, SendGrid and Firebase Cloud Messaging) to deliver push notifications and real-time alerts to users 12A or 12B. The cloud-based server 30 monitors changes to property listings and sends real-time alerts to users 12A or 12B when relevant events occur, such as new properties matching the user’s 12A or 12B preferences becoming available, price changes occur on saved properties, and/or new three-dimensional models or virtual tours are uploaded. If a user 12A or 12B requests to contact a real estate agent, the cloud-based server 30 sends a message request to the appropriate agent through electronic mail using the integrated messaging services 110. This messaging integration ensures that users 12A or 12B are always informed and can communicate easily with agents, enhancing engagement and satisfaction.

The content management system (CMS) 40 is a headless, API-driven platforms that manages unstructured media content, such as images, videos, promotional banners, and three-dimensional models, which are essential to providing an immersive augmented reality (AR) experience within the mobile application 10A or 10B. The content management system (CMS) 40 interacts with both the mobile application 10A or 10B and the web-based platform 20 to ensure that all media content is synchronized in real-time across the system 1000. The content management system (CMS) 40 is designed with scalability, flexibility, and high availability in mind. It can store media files locally or integrate with external cloud storage services 60 (for example, AWS S3) to provide dynamic content delivery. Being a headless content management system (CMS), it functions solely through API calls, without being tied to a specific presentation layer, allowing seamless integration with different components of the system 1000.

The content management system (CMS) 40 comprises several key modules, ensuring efficient storage, retrieval, and management of unstructured media content. A media storage module (not shown) stores various media types, including images, videos, audio files, and three-dimensional models. It either stores content locally within the content management system (CMS) 40 or manages references to media hosted on external cloud storage services 60. A metadata repository (not shown) keeps track of metadata associated with media files, such as file format, resolution, size, upload date, and property associations (for example, which three-dimensional model belongs to which property). This metadata allows for efficient retrieval and ensures that the right content is dynamically served to the mobile application 10A or 10B. A content delivery API exposes endpoints that allow the mobile application 10A or 10B and web-based platform 20 to request media content. These APIs provide media in real time based on the user’s 12A or 12B interaction with the system 1000. A cache layer implements caching to ensure that frequently accessed content is stored temporarily and delivered faster on subsequent requests, reducing latency and load on the backend. A version control module (not shown) manages multiple versions of media files. If a property image, video, or three-dimensional model is updated, the content management system (CMS) 40 may retain previous versions to ensure that older content can still be accessed if needed.

The content management system (CMS) 40 interacts with the cloud-based server 30 to ensure that media content is delivered promptly. When the mobile application 10A or 10B requests property information and media, the cloud-based server 30 retrieves structured property data from the main database 34 and simultaneously queries the content management system (CMS) 40 to obtain the required media content. The main API 34 on the cloud-based server 30 sends request to the content management system (CMS) 40, specifying the type of media (for example, images, video, or three- dimensional models) and associated property metadata. The content management system (CMS) 40 responds by delivering the relevant content through API endpoints, which the cloud-based server 30 forwards to the mobile application 10A or 10B or webbased platform 20. The content management system (CMS) 40 plays a critical role in managing three- dimensional models of properties. When administrators 22 upload a three-dimensional model of a building (existing or preconstruction), the content management system (CMS) 40 tags the model with property metadata and stores it either locally or in an external cloud-based storage service 60. When a user 12A or 12B in the mobile application 10A or 10B selects a property with a three-dimensional model, the mobile application 10A or 10B retrieves the relevant model through the cloud-based server 30 and renders it using ARKit (for iOS) orARCore (for Android). The three-dimensional model is placed at the correct geolocation coordinates in the real-world environment, allowing users to walk around the virtual structure and explore it interactively.

Below follows a step-by-step explanation of how a potential homebuyer, Ms. Homehunter, uses the system 1000 to explore a future property (that is, a preconstruction property).

Firstly, Ms. Homehunter downloads the mobile application 10A or 10B from the App Store or the Google Play store, depending on the operating system of her smart device. Upon opening the mobile application 10A or 10B, Ms. Homehunter is prompted to log in using her Google account. The mobile application 10A or 10B communicates with the cloud-based server 30, which sends an OAuth authentication request to Google Authenticator 90. After successfully authenticating, the cloud-based server 30 generates a secure token, enabling Ms. Homehunter to access her personalized profile and saved preferences (if available). The mobile application 10A or 10B also requests access to Ms. Homehunter’s smart device’s camera, GPS location, and notifications. These permissions are essential for delivering the augmented reality (AR) experience, tracking her location, and sending updates about properties matching her search criteria. Once granted, the geolocation module begins tracking her position in real time.

Ms. Homehunter activates the augmented reality (AR) interface by tapping an “Explore” button. The mobile application 10Aor 10B causes the smart device’s camera to open, capturing the real-world environment in front of her. The geolocation module sends her current GPS coordinates and the orientation of her smart device’s camera to the ViewModel layer of the mobile application 10A or 10B. The ViewModel layer generates a data request containing her GPS coordinates and search preferences (for example, single-family homes under $ 500,000.00 within 5 kilometers). This request is sent via the main API 32 to the cloud-based server 30. The cloud-based server 30 queries the property databases 50A and/or 50B and/or 34 and returns the results to the mobile application 10A or 10B. If the properties include media content (for example, three-dimensional models or videos), the cloud-based server 30 also sends a request to the content management system (CMS) 40 to retrieve those files. The content management system (CMS) 40 responds with either direct media files or links to external cloud storage services 60 where the media files are stored and can be retrieved from. The ViewModel layer binds the received data to the user interface and sends it to the augmented reality (AR) engine, which uses ARKit orARCore to overlay virtual property visual markers (for example, icons) onto the live camera feed of the smart device. As Ms. Homehunter moves the camera, augmented reality (AR) anchors ensure that the virtual icons remain aligned with the real-world coordinates. While exploring a neighborhood, Ms. Homehunter points her smart device at a nearby property. The mobile application 10A or 10B sends a data request to the cloud-based server 30, which retrieves both the structured property data (for example, location, price, and size) from the main database 34, and/or the MLS 50A and/or the IDX 50B, and street-level imagery from the geolocation services 70 (for example, Google Maps and Google Street View) based on the property’s geolocation. A property icon appears in the augmented reality (AR) interface, displaying a brief description, the asking price, and the number and types of rooms. She taps the icon to learn more. This action triggers a secondary data request to the cloud-based server 30. In response, the cloud-based server 30 retrieves detailed property information from the main database 34 and forwards it to the mobile application 10A or 10B. The augmented reality (AR) interface now displays a popup with additional details, including agent contact information and a button to start a virtual tour.

Curious about the interior, Ms. Homehunter taps the “Virtual Tour” button. The mobile application 10A or 10B sends a request to the content management system (CMS) 40, via the main API 32, which returns a panoramic video showcasing the property’s interior. This can also be a three-dimensional model showcasing the property’s interior. She navigates the virtual tour (that is, the panoramic video or the three-dimensional model) by rotating her smart device, moving seamlessly through the living room, kitchen, and other rooms of the property.

Next, Ms. Homehunter notices an empty site close by that has a proposed development. She points her phone camera towards this site and taps on the three- dimensional model preview to visualize the future development. The mobile application 10A or 10B retrieves the three-dimensional model from the content management system (CMS) 40, via the main API 32, and the augmented reality (AR) engine renders it in the correct location on the augmented reality (AR) interface. Here, imagery of the surroundings is also obtained from the geolocation services 70, by means of the main API 32, for display in the augmented reality (AR) interface alongside the augmented reality (AR) projections. Ms. Homehunter walks around the site, viewing the virtual building from different angles, gaining a better sense of the structure’s scale and design.

Ms. Homehunter notices a “Stage It” button on the mobile application 10A or 10B. Upon tapping the button while viewing an image of a property, the mobile application 10A or 10B sends a request to the cloud-based server 30 and/or the content management system (CMS) 40 via the main API 32. The server 30 returns a stagingimage of the empty space, allowing her to select from a catalog of styles based on her personal taste. Upon selecting her preferred style, the system 1000 causes the staging-image to be updated with the selected style (for example, color schemes, furniture, fittings), which is then sent to the mobile application 10A or 10B where it can be viewed instantly by Ms. Homehunter.

Alternatively, when Ms. Homehunter is physically visiting the property and using the mobile application 10A or 10B for an augmented reality (AR) walkthrough of the property (that is, a walkthrough of the three-dimensional model of the relevant property), she can tap the “Add Furniture/Fittings” button to view virtual furniture or fittings within the augmented reality (AR) projection. The AR engine allows Ms. Homehunter to select and place virtual furniture and fittings directly into the augmented l ' l reality (AR) projection, thereby customizing the layout and style of the three- dimensional model of the property to match her preferences. As she moves through the property, her chosen furniture adjusts to the space (based on her geolocation and thus position within the three-dimensional model of the property), providing an interactive and personalized experience. This feature enables Ms. Homehunter to visualize the property, whether existing or preconstruction, both through static images and in real-time augmented reality (AR), tailored to her personal taste.

As Ms. Homehunter continues exploring the neighborhood in the augmented reality (AR) interface, she notices advertisements for local businesses. For example, a banner promoting a nearby coffee shop appears as the points her camera in its direction. These advertisements are provided by the advertisement integration module 100, which delivers relevant promotions based on Ms. Homehunter’s location and preferences. The cloud-based server 30 communicates with the advertisement integration module 100, and the augmented reality (AR) engine integrates advertisements into the augmented reality (AR) projections.

Ms. Homehunter finds a property she likes and taps the “Save Property” button. The mobile application 10A or 10B sends this action to the cloud-based server, which updates her profile in the backend. The cloud-based server 30 ensures that this property is now part of her saved searches. Later that day, the real estate agent updates the asking price for the saved property. In response to this update, the cloudbased server 30 causes the messaging service 110 to send a push notification to Ms.

Homehunter’s smart device. Ms. Homehunter decides to unlock premium search features within the mobile application 10A or 10B, such as access to exclusive listings and virtual tours. She selects a subscription plan and initiates a payment. The mobile application 10Aor 10B sends the payment request to the cloud-based server 30, by means of the main API 32, which processes it through a payment gateway 80. After receiving payment confirmation, the cloud-based server 30 updates Ms. Homehunter’s account status, granting her access to premium content.

Ms. Homehunter decides to contact the agent for more details about the property. She taps the “Contact Agent” button, which sends a message request through the cloudbased server 30 to the messaging service 110. The message is delivered to the agent via electronic mail, facilitating quick communication.

Meanwhile, the authorized real estate agent (or administrator 22 logs into the webbased platform 20 to manage property listings. This is a real estate administrator or agent who has been granted access to the system 1000 through the web-based platform 20. In other words, the system 1000 only permits real estate administrators or agents who has subscribed to the system 1000 to interact therewith. The authorized administrator 22 updates the property’s description and uploads new high-resolution images to the content management system (CMS) 40. These changes are immediately synchronized across the system 1000, becoming available in both the mobile application 10A or 10B and web-based platform 20. Ms. Homehunter sees the updated description and images in real time, thanks to the synchronization between the cloud-based server 30 and the content management system (CMS) 40. As it is clear from the above example, the system 1000 offers Ms. Homebuyer a seamless and engaging real estate experience, using augmented reality to explore properties in real time. The mobile application 10A or 10B, cloud-based server 30, CMS 40, and web-based platform 20 work together to provide accurate data, immersive visual content, and smooth communication with real estate agents. With the integration of geolocation services, payment gateways, advertising modules, and messaging services, the system offers a user-friendly and efficient solution for property exploration and management, providing immediate, context-aware property information based on geolocation and camera orientation.

Claims

1 . A system for augmented reality-based real estate exploration and property management, comprising: a mobile application, configured to run on a smart device with a camera and geolocation capabilities, the mobile application comprising: o an augmented reality (AR) interface that dynamically overlays property-related data onto a live camera feed of the smart device, wherein the property-related data includes property information and visual elements rendered in real-time based on the smart device’s geolocation and camera orientation; o a geolocation module configured to determine the location of the smart device; o a data request module configured to send property-related requests to a cloud-based server based on the geolocation and camera orientation of the smart device; and o a user interaction module configured to allow a user to select and view additional property details, virtual tours, and three- dimensional models of properties through the AR interface; a web-based platform, accessible by administrators via a web-based interface, the web-based platform comprising: o an interface for managing property data, including creating, updating, and deleting property listings, which is communicated to the cloud-based server; and o an interface for uploading and managing media content, including property images, videos, and three-dimensional models, wherein the media content is communicated to a content management system (CMS) for storage and retrieval; a cloud-based server, communicatively coupled with the mobile application and the web-based platform, the cloud-based server comprising: o a main application programming interface (API) configured to receive data request from the mobile application and the webbased platform; o a property database configured to store structured property data, including property location, price, and attributes; o an integration service configured to retrieve up-to-date property data from external real estate listing services; and a headless content management system (CMS) commutatively coupled to the cloud-based server, configured to: o store and manage unstructured media content related to properties, including images, videos, and three-dimensional models; and o provide media content dynamically to the mobile application and web-based platform via API connections, wherein the mobile application, upon receiving a user’s geolocation and camera orientation, retrieves property data from the cloud-based server and displays the property data dynamically via augmented reality projections on the smart device’s display, and wherein the web-based platform allows administrators to manage and update property data and upload media content, including three- dimensional models and images, to the content management system, and wherein the mobile application dynamically retrieves these updates from the cloud-based server, which, in turn, fetches the media content from the content management system as needed.

2. The system of claim 1 , wherein the augmented reality interface is configured to display property visual markers and three-dimensional models at varying scales, based on the distance between the smart device and the respective property, so that properties closer to the user appear larger and those farther away appear smaller.

3. The system of claim 1 , wherein the geolocation module is configured to track changes in the user’s location in real time, and the mobile application automatically updates the property data and augmented reality projections as the user moves within a geographic area.

4. The system of claim 1 , wherein the integration service within the cloud-based server is configured to retrieve real-time property data from multiple real estate listing services, including but not limited to multiple listing services (MLS) and internet data exchange (IDX), to ensure that property listings are current and accurate.

5. The system of claim 1 , wherein the content management system (CMS) is further configured to store three-dimensional models of existing and preconstruction properties, and the mobile application renders these models in the augmented reality interface at the exact location where the building is or will be constructed, using real-world coordinates provided by the geolocation module.

6. The system of claim 1 , wherein the mobile application is further configured to display a virtual tour module, allowing users to select a property visual marker and view a virtual walkthrough of the property’s interior, with images and video data fetched from the content management system (CMS).

7. The system of claim 1 , wherein the cloud-based server is further communicatively coupled with: geolocation and mapping services to retrieve geolocation data, imagery of properties and their surroundings, route guidance, and nearby points of interest, which are displayed dynamically alongside the augmented reality projections; payment gateways for secure payment processing within the mobile application, enabling users to purchase additional features for the mobile application; authentication services for allowing users to log into the mobile application using their social media or electronic mail accounts; messaging services for sending electronic mail notifications and push notifications to the users; and an advertisement service for incorporating advertisements based on the user’s geolocation into the augmented reality projections.

8. A computer-implemented method for augmented reality-based real estate exploration and property management, comprising: launching a mobile application on a smart device, wherein the mobile application includes an augmented reality interface and a geolocation module; capturing geolocation data and camera orientation from the smart device; sending a data request from the mobile application to a cloud-based server, the request including the captured geolocation data and camera orientation; retrieving property data from the cloud-based server, the property data including structured property information from a property database and unstructured media content from a content management system; overlaying the retrieved property data dynamically onto a live camera feed within the augmented reality interface of the mobile application, wherein property visual markers and three-dimensional models are displayed based on the user’s geolocation and camera orientation; allowing the user to interact with the augmented reality interface, enabling the selection of property visual markers to view additional property details, virtual tours, or three-dimensional models; receiving updated property data in real-time from the cloud-based server as the user’s geolocation or camera orientation changes.

9. The computer-implemented method of claim 8, further comprising scaling the property visual markers and three-dimensional models displayed in the augmented reality interface based on the distance between the smart device and the respective property, such that properties closer to the user appear larger and those farther away appear smaller.

10. The computer-implemented method of claim 8, further comprising tracking the user’s movement by means of the geolocation of the mobile application, and automatically updating the property data and augmented reality projections based on the user’s current location.

11 . The computer-implemented method of claim 8, wherein the mobile application allows the user to access a virtual tour of a selected property, the computer- implemented method further comprising retrieving virtual tour data, including images and video content, from the content management system and displaying it within the augmented reality interface.

12. The computer-implemented method of claim 8, further comprising retrieving real-time property data from external real estate listing services, including but not limited to multiple listing services (MLS) and internet data exchange (IDX), and displaying the retrieved data in the augmented reality interface based on the user’s geolocation and camera orientation.

13. The computer-implemented method of claim 8, further comprising rendering three-dimensional models of existing or preconstruction properties in the augmented reality interface, the computer-implemented method further comprising rendering three-dimensional model data from the content management system and rendering the models at the correct real-world location based on geolocation data provided by the mobile application.

14. The computer-implemented method of claim 8, further comprising: retrieving geolocation data, imagery of properties and their surroundings, route guidance, and nearby points of interest for dynamic display alongside the augmented reality projections by communicatively coupling the cloud-based server to a geolocation and mapping service; enabling users to purchase additional features for the mobile application by communicatively coupling the cloud-based server with a payment gateway; allowing users to log into the mobile application using their social media or electronic mail accounts by communicatively coupling the cloudbased server with an authentication service; sending electronic mail and push notifications to the user by communicatively coupling the cloud-based server to a messaging service; and incorporating advertisements into the augmented reality interface based on the user’s geolocation by communicatively coupling the cloud-based server to an advertisement service.