top of page

How to Use SARA Robot Perception System

The perception system of the SARA robot plays a crucial role in its ability to accurately detect the gender and age of individuals and display customized advertisements accordingly. This innovative feature sets SARA apart from traditional advertising methods, as it allows for targeted marketing based on real-time data. By utilizing a high-resolution camera and implementing advanced algorithms, the robot is able to analyze facial features and make accurate determinations about the age and gender of people in its vicinity.

To achieve this level of accuracy, the recommended solution involves several key steps. First, a high-resolution camera is installed on the SARA robot to capture clear images of individuals' faces. This ensures that facial features can be accurately analyzed for age and gender recognition. The use of a high-resolution camera is essential for capturing detailed information necessary for precise analysis.

Next, a face detection algorithm is implemented to identify faces in front of the robot. This algorithm uses sophisticated techniques to locate and isolate individual faces within an image or video stream. By detecting these faces, SARA can focus its analysis solely on relevant individuals, ensuring that ads are displayed only when there are people present.

Once faces are detected, SARA employs age and gender recognition algorithms to analyze various facial features. For age estimation, the algorithms consider aspects such as wrinkles, skin texture, and hair color to accurately determine an individual's age range. Simultaneously, gender recognition algorithms evaluate facial structure and other visual cues associated with gender identification. By integrating these analyses, SARA can make informed decisions about which advertisements are most relevant, tailoring them to both the estimated age group and gender of each person.

The final step in utilizing the perception system of the SARA robot is displaying the customized ads. Once the age and gender of individuals have been determined, SARA's algorithm selects from a list of ads that correspond to this demographic information. The chosen ad is then displayed on the robot's screen, ensuring that it captures the attention of the intended audience.

Step 1: Installing a High-Resolution Camera

To set up the perception system of the SARA robot, start by installing a high-resolution camera, preferably with at least 1080p resolution, to accurately detect faces and analyze age and gender.

The camera is placed above the screen, in the center of the robot, with an inclined angle of 75 degrees in order to detect the faces of the people in front of the robot.

After securely mounting the camera, connect it to the Raspberry Pi using a USB cable. Testing its functionality is vital to ensure clear image capture and seamless data transmission, laying the groundwork for the implementation of face detection algorithms.

Step 2: Implementing Face Detection Algorithm

To effectively utilize the perception system of the SARA robot for gender and age recognition, it is essential to implement a face detection algorithm. This algorithm plays a crucial role in identifying faces in front of the robot and enables further analysis for age and gender recognition.

The face detection algorithm is designed to locate and identify human faces within an image or video frame. It utilizes advanced computer vision techniques to detect facial features such as eyes, nose, and mouth. This algorithm operates by analyzing patterns and shapes that are commonly found in human faces, allowing it to accurately identify faces even under varying lighting conditions or different angles.

To implement the algorithm, it is important to consider factors such as computational resources and memory limitations on the SARA robot. The algorithm should be efficient enough to run smoothly without causing any performance issues or delays.

After successfully implementing the face detection algorithm, it is now possible to detect faces in front of the SARA robot. The captured images or video frames are processed using this algorithm, enabling precise identification of individuals within its field of view.

Step 3: Age and Gender Recognition in SARA's Perception System Age and gender recognition are pivotal components of SARA's perception system, enabling it to display tailored ads that resonate with its audience. Both processes involve implementing specific algorithms that analyze facial features to determine age and gender.

For age recognition, the system preprocesses captured images, normalizing lighting and removing noise. Facial landmarks like eyes, nose, and mouth are identified, serving as reference points for age-related attributes like wrinkles and skin texture. Training an accurate model requires a vast dataset with age-labeled images, typically using machine learning algorithms like convolutional neural networks (CNNs). During real-time operation, these trained models estimate the age of detected faces, providing either an age range or a specific age. It's worth noting that while advancements have improved accuracy, factors like lighting and individual variations can affect results.

Gender recognition, on the other hand, is crucial for understanding consumer preferences. Recognizing gender allows SARA to enhance ad personalization, increasing engagement. The process begins by selecting a proven machine learning algorithm trained on a large dataset of gender-labeled images. Real-time images captured by SARA's camera are processed by this algorithm, which analyzes features such as the jawline and eyebrow shape to determine gender. The effectiveness of gender recognition can vary based on factors like image quality and facial differences across ethnicities. Regular updates to the algorithm ensure SARA stays current with evolving trends and norms in gender identification.

Together, these recognition systems empower SARA to deliver targeted advertising based on the age and gender of its audience, optimizing its advertising impact.

Step4: Displaying Customized Ads

To maximize the effectiveness of the SARA robot's advertising capabilities, it is essential to display customized ads based on the age and gender of the individuals in front of the robot. This step ensures that the ads resonate with the target audience and increase the likelihood of engagement.

Once the SARA robot has successfully detected and recognized the age and gender of the people in its vicinity, it proceeds to determine which ads are most appropriate for each demographic. The algorithm within the robot's system utilizes this information to select from a list of pre-defined ads that correspond to the identified age range and gender.

The video below shows how the Ads are displayed and flipped between each other according to the detection of a gender "male" and age range "[25-32]"

This is also an example of publishing manually the age and gender just to test the algorithm, the video below is for a gender "male" and age "12"

Step5: Achieve Real-Time Image Processing

To achieve real-time image processing and optimize performance, the SARA robot employs a two-step process. First, a high-resolution camera installed on the robot captures images of individuals in front of it. These images are then transmitted to a laptop connected to the same local network using ROS2 (Robot Operating System 2) with a shared domain.

On the laptop, advanced image processing algorithms analyze each captured image and extract relevant data such as age and gender. By offloading this processing task to a more powerful device, such as a laptop, the SARA robot can ensure accurate and efficient recognition results.

Once these algorithms have determined an individual's age and gender, this information is sent back to the SARA robot for immediate action. The robot's screen displays ads that are specifically tailored to appeal to each identified demographic. For example, if a middle-aged woman is detected by SARA, advertisements related to beauty products or household items may be displayed.

By displaying customized ads based on age and gender, marketers can effectively target their desired audience with precision. This personalized approach increases engagement rates as individuals are more likely to pay attention to advertisements that align with their interests or needs.


In conclusion, the perception system of the SARA robot revolutionizes advertising by enabling customized ad delivery based on gender and age recognition. With its high-resolution camera, face detection algorithm, and advanced age and gender recognition algorithms, this smart autonomous robotic advertiser provides an unparalleled level of personalization in advertising campaigns.

Marketers can leverage this technology to gain valuable insights into their target audience and deliver tailored messages that resonate with different demographics. The ability of the SARA robot to navigate autonomously further enhances its effectiveness as an advertising tool. By combining state-of-the-art technology with innovative marketing strategies, the SARA robot opens up new possibilities for businesses to engage with their customers in a meaningful and impactful way.

[6/August ~ 18/August 2023]

3 views0 comments

Recent Posts

See All


bottom of page