Deep learning gateway on Raspberry Pi and other edge devices

The first competitive instance segmentation approach that runs on small edge devices at real-time speeds.

Slimmable Networks, AutoSlim, and Beyond, ICLR 2019, and ICCV 2019

ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation

LFD is a big update upon LFFD. Generally, LFD is a multi-class object detector characterized by lightweight, low inference latency and superior precision. It is for real-world appilcations.

Helmut Hoffer von Ankershoffen experimenting with arm64 based NVIDIA Jetson (Nano and AGX Xavier) edge devices running Kubernetes (K8s) for machine learning (ML) including Jupyter Notebooks, TensorFlow Training and TensorFlow Serving using CUDA for smart IoT.

The core runtime engine for Ambianic Edge devices.

Real-time speech enhancement mobile app using Nested U-Net

Python library for serverless Federated Learning experiments.

Code for paper "EdgeKE: An On-Demand Deep Learning IoT System for Cognitive Big Data on Industrial Edge Devices"

This repository is a PyTorch implementation of NIPS 2019 Paper "Shallow RNNs: A Method for Accurate Time-series Classification on Tiny Devices"

A lightweight quantization module for PyTorch models.

Characterization study repository for pruning, a popular way to compress a DL model. this repo also investigates optimal sparse tensor layouts for pruned nets

Ratio1 Edge Node

A lightweight, resource-efficient MLOps monitoring solution for machine learning models deployed on edge devices. Features system health tracking, model I/O logging, drift detection, and cloud telemetry.

A modular CLI chatbot with Discord webhook integration optimized for edge devices using GGUF quantized models.

Edge-level Raspberry Pi node for collecting sensor data and sending it to the central server using RabbitMQ.

Deploy a secure, infinitely-scalable API for use in our workflow, accompanied by SDKs for use in working with common deployment devices.

AI traffic calculator using IoT and live data telemetry.

Official Repository of CascadedViT: Cascaded Chunk-FeedForward and Cascaded Group Attention Vision Transformer