Get Started
AI Analysis in Detail
Appendix

AI Analysis in Detail

This chapter lists, for every analysis type of the AI Analysis action, its commands, settings, output variables, and JSON result format. For the concept and the setup procedure see Part 4, AI Analysis; for registering analyzers and their mode and detection FPS see Part 6, AI Analyzer. All analysis runs on the controller; video and audio are never sent outside.

In this chapter

  1. Common ItemsAnalyzer and Type Select the analyzer to use in AI Analyzer . Analyzers can be added, edited, and deleted directly in th…
  2. Object DetectionDetects 80 kinds of common objects such as people and vehicles in real time from the camera video. The classes are the 8…
  3. Face DetectionDetects human faces in real time from the camera video and tracks their positions. Includes emotion recognition and age …
  4. Face RecognitionAn extension of Face Detection that compares detected faces against enrolled faces to identify who they are. Enrolling a…
  5. Pose EstimationEstimates a person's pose in real time from the camera video and provides the coordinates of 17 key points (joints). Dis…
  6. Hand TrackingTracks hands in real time from the camera video and provides the coordinates of 21 key points (finger joints). Includes …
  7. Color TrackingFinds regions of a specified color range in real time from the camera video and provides their position, size, area, and…
  8. QR / BarcodeDetects and decodes QR codes and several one-dimensional barcode formats in real time. Commands Command Description Scan…
  9. OCR (Text Recognition)Detects and reads text in real time from the camera video. The recognition language is chosen in the analyzer setting OC…
  10. Line TrackingFor line-following robots. Detects a line on the floor and provides its offset from the frame center, its tilt angle, an…
  11. Line Crossing CounterAutomatically counts people entering and exiting across a virtual line drawn on the camera preview. Used for entrance fo…
  12. Fire DetectionDetects flames in real time from the camera video. A digital variable that turns true when the fire probability exceeds …
  13. Action RecognitionRecognizes what a person is doing from 400 action categories (walking, running, sitting, clapping, cooking, and more). U…
  14. Hand Motion RecognitionRecognizes 25 hand motions performed in front of the camera (swipes, thumb up, stop sign, and more). The model is traine…
  15. License Plate RecognitionDetects vehicle license plates in real time from the camera video and reads their text. The plate model is chosen in the…
  16. Teachable Machine ClassificationClassifies the camera video with an image classification model trained in Google Teachable Machine. The model is uploade…
  17. Edge Impulse ClassificationClassifies images or sound with a classification model trained in Edge Impulse. Video and audio analyzers use the same c…
  18. Edge Impulse Object DetectionDetects objects in the camera video with an object detection model trained in Edge Impulse. The model is uploaded in the…
  19. Edge Impulse Visual AnomalyJudges normal versus abnormal states with a visual anomaly detection model trained in Edge Impulse. The frame is divided…
  20. Sound ClassificationA type of the audio analyzer. Classifies the sound from the microphone input (or the speaker output) into one of the 521…
  21. Edge Impulse Classification (Audio)Choosing Edge Impulse Classification as the audio analyzer's AI Model recognizes and classifies sound with an audio clas…