Home / SENTINEL
Private Sector
Stage 1, Stage 2

SENTINEL

Plegma Labs S.A.
‹ Back to Open Call Winners
SENTINEL is a computer vision system that monitors worker safety and hygiene compliance in industrial food production facilities. It analyses live video from standard CCTV cameras to detect in real time whether workers wear the required gloves and hats, and whether their hands enter hazardous zones around ovens, slicers and packaging lines. It fuses the feeds with thermal imaging that reads oven heat signatures, so an ungloved hand approaching a surface hot enough to burn is escalated as genuine danger. Inference runs on premises and faces are blurred, so footage never leaves the facility. The product is at TRL 7, demonstrated at HELIOS, a bakery and pastry production facility.

Background

Safety and hygiene breaches in food production remain a persistent source of injuries, contamination incidents and regulatory exposure. Supervisors cannot watch every workstation at all times, and burn, cut and contamination risks around ovens, slicers and packaging lines often go unnoticed. General purpose computer vision safety products are built for construction and general manufacturing. They detect helmets and vests but do not distinguish genuine heat and cut resistant gloves from ordinary latex, and cannot reason about burn risk near ovens. Privacy and connectivity concerns also block cloud-based vision products from food production floors.

Proposed solution

SENTINEL ingests live video from CCTV cameras above production machines and detects, in real time, whether each worker wears the equipment required for the task, flagging missing heat and cut resistant gloves and head coverings the moment a worker enters a monitored zone, and tracking hand position relative to hazardous machine zones. The AI approach is supervised object detection, with models tuned for the lighting, occlusion and motion of real shop floors. A second path fuses the RGB detections with thermal imagery reading oven and hot surface heat signatures, so the system reasons about burn risk by combining the position of a bare hand with nearby equipment temperatures. Detections become anonymous events and alerts that a supervisor acts on. Inference runs on premises and faces are blurred, so footage never leaves the facility. The product is at TRL 7, demonstrated at HELIOS, a bakery and pastry production facility, under real production conditions. The detection service runs on standard cameras and edge hardware with a containerised deployment, so onboarding a new plant is a matter of configuration.

Objectives

  • Detect in real time, from standard CCTV cameras, whether food production workers wear the required protective and hygiene equipment, such as gloves and hats
  • Detect when workers’ hands enter hazardous zones around ovens, slicers and packaging lines
  • Fuse thermal imaging of oven heat signatures to prioritise alerts when an ungloved hand approaches a hot surface
  • Protect privacy with on-site processing and automatic face blurring
  • Validate our models through a testing workflow and document SENTINEL’s EU AI Act position for adopters
  • Offer SENTINEL through the AI-on-Demand Marketplace

Plegma Labs S.A.

Greece
PLEGMA LABS S.A. (PLEGMA) is a Greek SME founded in 2013, specialising in AI, data analytics, computer vision and IoT for industrial settings. PLEGMA boasts a robust team of professionals (https://pleg.ma/team) proficient in software development, IoT, energy optimization, data science and computer vision, leveraging a rich history of involvement and technical management in commercial and EU-funded R&I initiatives (pleg.ma/projects/), and its commercial IoT platform (cloud.gr) which offers a suite of data analytics and IoT services.
Stay informed on AI opportunities
Get updates on new solutions, market trends, and adoption strategies delivered to your inbox.
The DeployAI project has received funding from the Digital Europe Programme (DIGITAL) under grant agreement №. 101146490 - DIGITAL-2022-CLOUD-AI-B-03
Stay informed on AI opportunities
Get updates on new solutions, market trends, and adoption strategies delivered to your inbox.
The DeployAI project has received funding from the Digital Europe Programme (DIGITAL) under grant agreement №. 101146490 - DIGITAL-2022-CLOUD-AI-B-03