Skip to content

DeepCamera is intrusion detection AI camera for Home-Assistant delivered by SharpAI. SharpAI empowers your traditional CCTV/NVR and surveillance cameras with machine learning technologies. It provides DeepCamera, fall detection and parking lot monitoring with the inference engine on your local device.

License

Notifications You must be signed in to change notification settings

afiqmuzaffar/DeepCamera

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

842 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Intrusion detection AI camera with Home-Assistant

DeepCamera empowers your traditional surveillance cameras and CCTV/NVR with machine learning technologies. It provides open source facial recognition based intrusion detection, fall detection and parking lot monitoring with the inference engine on your local device.

SharpAI-hub is the cloud hosting for AI applications which help you deploy AI applications with your CCTV camera on your edge device in minutes.

Install SharpAI on Jetson Nano/Xavier AGX/Windows/Linux/MacOS

  • Register account on SharpAI website
  • Install sharpai-hub: pip3 install sharpai-hub
  • Login on device: sharpai-cli login
  • Register device: sharpai-cli device register

Start DeepCamera

  • DeepCamera uses MTCNN for face detection and InsightFace's ArcFace for face recognition, it leverages SVM from SKLearn as classifier and a private implemetation from Frank Zuo to fine-tune accuracy. To handle unbalanced dataset distribution which is most likely seen when you start to labelling unknown faces, we deployed upsampling policy to your own labelled face dataset. All the inference code as well as AutoML training code are running on your own device.
  • The DeepCamera commerical version which had been deployed to a large-scale AI smart city construction project has strong backend design to support large scale edge device cluster with redis. The commerical version provides private cloud deployment for security requirement.
  • Learned from the open source community, it was a painful procedure to deploy a private cloud solution on your own device, we provide free cloud host for evaluation and non-commericial use with limited storage quota, so you can easily use following command line to setup DeepCamera on your own device in 5-minutes:

1. Following command will start DeepCamera and Home-Assistant with docker-compose.

sharpai-cli deepcamera start

2. Land-on Home-Assistant with URL: http://localhost:8123

3. Add your Camera through Home-Assistant camera integration

4. Added SharpAI configuration to configuration.yaml

stream:
  ll_hls: true
  part_duration: 0.75
  segment_duration: 6

image_processing:
  - platform: sharpai
    source:
      - entity_id: camera.<camera_entity_id>
    scan_interval: 1

5. Access detection result on SharpAI website

6. Integration with Home-Assistant

Other Applications(early release)

Tested Devices

Edge AI Devices / Workstation

Tested Camera:

  • DaHua / Lorex / AMCREST: URL Path: /cam/realmonitor?channel=1&subtype=0 Port: 554
  • Ip Camera Lite on IOS: URL Path: /live Port: 8554

Support

If you are using a camera but have no idea about the RTSP URL, please join SharpAI community for help or use iSpyConnect to get camera streaming URL format. SharpAI provides commercial support to companies which want to deploy AI Camera application to real world.

DeepCamera Architecture

architecture

Commercial Version

  • Provide real time pipeline on edge device
  • E2E pipeline to support model customization
  • Cluster on the edge
  • Port to specific edge device/chipset
  • Voice application (ASR/KWS) end to end pipeline
  • ReID model
  • Behavior analysis model
  • Transformer model
  • Contrastive learning
  • Click to join sharpai slack channel for commercial support

FAQ

How to install Docker-compose on Jetson Nano

sudo apt-get install -y libhdf5-dev python3 python3-pip
pip3 install -U pip
sudo pip3 install docker-compose==1.27.4

How to create token for Telegram Bot(DOC W.I.P)

  • Create Telegram Bot through @BotFather
  • Set Telegram Token in Configure File
  • Send message to the new bot you created

About

DeepCamera is intrusion detection AI camera for Home-Assistant delivered by SharpAI. SharpAI empowers your traditional CCTV/NVR and surveillance cameras with machine learning technologies. It provides DeepCamera, fall detection and parking lot monitoring with the inference engine on your local device.

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • JavaScript 39.2%
  • Python 29.6%
  • C++ 16.9%
  • EJS 4.4%
  • CSS 2.4%
  • SCSS 1.8%
  • Other 5.7%