
Iot Network Edge Engineer
- 26 installs
- 7 repo stars
- Updated May 20, 2026
- daemon-blockint-tech/agentic-enteprises-skill
Guides IoT network and edge engineering: MQTT/CoAP device connectivity, LoRaWAN/Zigbee, edge gateways, device provisioning/PKI, OTA updates, and cloud IoT handoffs.
About
Guides IoT and edge network engineering covering device connectivity protocols, LPWAN/mesh, edge gateways and bridges, MQTT broker scale, device identity/OTA, and cloud IoT integration. A developer uses it when designing device connectivity, MQTT topics, or edge gateway architectures.
- MQTT topic, ACL, and broker-scale design with shared subscriptions
- Edge store-and-forward with offline tolerance and OTA rollback
Iot Network Edge Engineer by the numbers
- 26 all-time installs (skills.sh)
- Ranked #3,410 of 4,347 Backend & APIs skills by installs in the Skillselion catalog
- Data as of Jul 29, 2026 (Skillselion catalog sync)
npx skills add https://github.com/daemon-blockint-tech/agentic-enteprises-skill --skill iot-network-edge-engineerAdd your badge
Show developers this skill is listed on Skillselion. Paste this into your README.
| Installs | 26 |
|---|---|
| repo stars | ★ 7 |
| Last updated | May 20, 2026 |
| Repository | daemon-blockint-tech/agentic-enteprises-skill ↗ |
What it does
Guides IoT network and edge engineering: MQTT/CoAP device connectivity, LoRaWAN/Zigbee, edge gateways, device provisioning/PKI, OTA updates, and cloud IoT handoffs.
Files
IoT Network & Edge Engineer
When to Use
- Design device connectivity—MQTT, CoAP, HTTP/REST device APIs; QoS, retain, and session semantics
- Plan LPWAN and mesh—LoRaWAN, Zigbee, Z-Wave, BLE transport roles and gateway backhaul
- Architect edge gateways and protocol bridges—northbound cloud, southbound field protocols
- Define MQTT topics, ACLs, and broker scale—namespace design, shared subscriptions, clustering
- Implement device identity, provisioning, and PKI—bootstrap, cert rotation, revocation
- Design OTA update architecture—staged rollouts, bandwidth-aware delivery, rollback at edge
- Engineer offline tolerance—store-and-forward, edge buffering, sync after reconnect
- Trade off bandwidth, latency, and battery—payload sizing, sleep schedules, edge aggregation
- Integrate cloud IoT platforms—AWS IoT Core, Azure IoT Hub, GCP IoT concepts; shadows and rules
- Deploy edge analytics and rules—Greengrass, IoT Edge modules, K3s edge workloads
- Segment IoT networks—dedicated VLANs/VRFs, zero-trust device access, broker isolation
- Operate fleet observability—metrics, last-will, desired/reported state, fleet health dashboards
When NOT to Use
- Enterprise Wi-Fi WLAN design, RF surveys, and 802.11 roaming (unless Wi-Fi is only one IoT transport) →
wireless-wifi-mobility-specialist - OT/ICS plant networks, Purdue model, and industrial control security →
scada-ics-cyber-security-specialist - Embedded firmware without connectivity, RTOS drivers, or bare-metal timing →
embedded-real-time-software-engineer - Carrier BGP/MPLS backbone, IX peering, and internet routing →
network-backbone-architect - SD-WAN overlay policy and branch breakout as primary deliverable →
sd-wan-engineer - Cloud landing zone, VPC foundation, and account guardrails →
cloud-architect - Implement cloud networking and managed services without IoT device plane →
cloud-engineer - Cloud security program, CSPM, and corporate IdP as primary deliverable →
cloud-security-engineer - Internal developer platform, golden paths, and portal roadmap →
platform-engineer - Geospatial pipelines, map matching, and fleet location APIs without connectivity layer →
geospatial-telematics-developer - ML training, feature stores, and model serving for telemetry analytics →
data-scientist/ml-ops-engineer
Related skills
| Need | Skill |
|---|---|
| Enterprise Wi-Fi, SSID/VLAN, 802.1X, roaming | wireless-wifi-mobility-specialist |
| OT/ICS segmentation, Purdue model, plant wireless | scada-ics-cyber-security-specialist |
| RTOS, drivers, MCU timing without network stack | embedded-real-time-software-engineer |
| Cloud VPC, landing zone, hybrid connectivity | cloud-architect |
| Cloud service implementation and operations | cloud-engineer |
| Cloud network security and guardrails | cloud-security-engineer |
| BGP/MPLS backbone and DCI | network-backbone-architect |
| SD-WAN overlay and branch policy | sd-wan-engineer |
| K8s platform, GitOps, cluster lifecycle | platform-engineer |
| GPS trajectories, PostGIS, geofencing APIs | geospatial-telematics-developer |
Core Workflows
1. Scope and boundaries
Clarify device classes, transports, scale targets, and compliance constraints.
See `references/iot_network_edge_scope.md`.
2. Connectivity and LPWAN
Select protocols, radio roles, and payload contracts per device class.
See `references/connectivity_protocols_and_lpwans.md`.
3. Edge gateways and bridges
Place gateways, map protocol translation, and define backhaul resilience.
See `references/edge_gateways_and_protocol_bridges.md`.
4. Identity, provisioning, and OTA
Bootstrap trust, rotate credentials, and stage firmware delivery safely.
See `references/device_identity_provisioning_ota.md`.
5. MQTT topics, brokers, and scale
Design namespaces, ACLs, HA brokers, and fleet-scale connection patterns.
See `references/mqtt_topics_brokers_and_scale.md`.
6. Cloud integration, operations, and security
Wire cloud IoT services, observability, segmentation, and runbooks.
See `references/cloud_integration_operations_security.md`.
Outputs
- Connectivity architecture — transports per tier, protocol matrix, QoS and retry policy
- Gateway and bridge spec — southbound/northbound maps, buffering, and failover behavior
- Topic and ACL catalog — hierarchy, shared subs, retained message policy, tenant isolation
- Provisioning and PKI runbook — bootstrap flows, cert templates, rotation and revocation
- OTA rollout plan — channels, rings, bandwidth budgets, rollback and attestation hooks
- Edge deployment model — modules/containers, offline sync, and cloud command path
- Fleet observability pack — metrics, shadows/state, alerts, and last-will semantics
- Segmentation diagram — VLANs/VRFs, firewall zones, broker tenancy, and zero-trust device access
Reference files
| File | Use when |
|---|---|
references/iot_network_edge_scope.md | Scoping, RACI, handoffs, in/out of scope |
references/connectivity_protocols_and_lpwans.md | MQTT/CoAP/HTTP, LoRaWAN, mesh radios |
references/edge_gateways_and_protocol_bridges.md | Gateway placement, bridges, store-and-forward |
references/device_identity_provisioning_ota.md | PKI, bootstrap, OTA rings and rollback |
references/mqtt_topics_brokers_and_scale.md | Topics, ACLs, clustering, millions of devices |
references/cloud_integration_operations_security.md | AWS/Azure/GCP IoT, edge runtimes, segmentation |
Cloud integration, operations, and security
Table of contents
1. Cloud IoT platform map 2. Device registry and shadows 3. Rules, jobs, and edge runtimes 4. Integration patterns 5. Network segmentation 6. Zero-trust device access 7. Fleet observability 8. Runbooks
Cloud IoT platform map
| Capability | AWS IoT Core | Azure IoT Hub / DPS | GCP (conceptual) |
|---|---|---|---|
| MQTT endpoint | Yes | Yes | Partner / Pub/Sub bridge patterns |
| Device registry | Thing + Thing Group | Device identity + DPS | Device registry APIs |
| Twin/shadow | Device Shadow | Device Twin | Device config / state |
| Rules/routing | IoT Rules → Lambda/Kinesis | Message routing → Event Hub | Dataflow / Cloud Functions |
| OTA | IoT Jobs + S3 | Device Update / ADU | Bucket + custom jobs |
| Edge | Greengrass v2 | IoT Edge modules | GKE/Anthos edge patterns |
Handoff: Landing zone, VPC, and private endpoints → cloud-architect / cloud-engineer. Device-plane policy → this skill.
Device registry and shadows
| Concept | Usage |
|---|---|
| Desired state | Cloud writes target config/firmware version |
| Reported state | Device acknowledges applied state |
| Delta | Rules trigger on drift between desired/reported |
| Version | Monotonic metadata for optimistic concurrency |
Design rules:
- Keep shadow small (<4–8 KB); large configs in object storage with URL in shadow.
- Split telemetry (high rate) from shadow (low rate state).
- Use named shadows only when product domains are truly independent.
Rules, jobs, and edge runtimes
Cloud rules
- Route telemetry to time-series DB, data lake, and alerting with filtering at ingress.
- Avoid complex business logic in rules—push to stream processors for maintainability.
Jobs (OTA, reboot, cert rotate)
- Target thing groups with rollout configuration.
- Report job progress on dedicated topics; surface failures per device.
Edge runtimes
| Runtime | Pattern |
|---|---|
| AWS Greengrass | Components as OCI artifacts; local MQTT bridge; IPC auth |
| Azure IoT Edge | Modules with routes; upstream to IoT Hub |
| K3s at edge | Helm releases; GitOps via platform-engineer; device plugins for hardware |
Offline: Edge rules continue; queue upstream sync; document conflict resolution when cloud desired changes during outage.
Integration patterns
Devices → Gateway/Bridge → MQTT Broker → Cloud IoT → Rules → Stream/TSDB
↓
Edge runtime (filter/ML/actuate)| Pattern | Description |
|---|---|
| Ingress bridge | Custom auth → IoT Core with IAM role least privilege |
| Twin command | Mobile/app writes desired; device reports progress |
| Digital twin (Azure) | Model-based simulation—separate from device twin ops |
| Event sourcing | Append-only telemetry bus; shadows for control plane only |
Coordinate downstream analytics with data-scientist / warehouse teams—define schema registry at MQTT boundary.
Network segmentation
| Zone | Typical contents | Controls |
|---|---|---|
| Device VLAN | Sensors, PLCs via gateways | No direct internet; ACL to gateway only |
| Gateway DMZ | Bridges, edge agents | Outbound 8883/TLS only; no inbound from internet |
| Corporate | Ops tooling | Jump host; read-only MQTT monitors |
| Cloud | PrivateLink/VNet integration | Broker endpoints private; no public shadow APIs |
IoT segmentation checklist:
- [ ] Dedicated VLAN/VRF per site or per tenant
- [ ] East-west denied except required gateway paths
- [ ] DNS filtering on gateway egress
- [ ] No flat /16 with cameras and PLCs shared
For plant floors, align with scada-ics-cyber-security-specialist before opening paths.
Zero-trust device access
| Control | Implementation |
|---|---|
| Identity | Per-device cert; no shared passwords |
| Least privilege | Topic ACLs; cloud IAM per pipeline |
| Continuous validation | Short cert TTL; deny revoked |
| Micro-segmentation | Gateway cannot reach corporate LDAP |
| Admin access | Break-glass bastion with MFA; no shared broker superuser |
Broker hardening: Disable anonymous; disable $SYS for non-admins; TLS 1.2+; cipher suites reviewed annually.
Engage cloud-security-engineer for org-wide KMS, SIEM forwarding, and detective controls.
Fleet observability
| Signal | Source |
|---|---|
| Connected/disconnected | Broker + cloud lifecycle events |
| Shadow drift | Desired ≠ reported > threshold |
| Message rate anomalies | Per-device baselines |
| OTA job success % | Cloud job API |
| Gateway health | Disk queue, CPU, bridge errors |
| RF metrics (if available) | LoRa SNR, Wi-Fi RSSI via gateway meta |
SLO examples:
- 99% devices report telemetry within 2× expected interval
- Command delivery P95 < 30s for online devices
- OTA success > 98% per ring before promotion
Runbooks
| Incident | Steps |
|---|---|
| Broker cert expiry | Pre-notify; dual trust chain; canary reconnect test |
| ACL mis-deploy | Roll back policy version; read-only mode for tools |
| Telemetry storm | Rate limit at gateway; scale shared subscription consumers |
| Region outage | Failover DNS to secondary broker; document dedupe |
| Compromised device | Revoke cert; quarantine thing group; forensic snapshot |
Maintain connection simulator in CI that mirrors production keepalive and payload sizes.
Cross-link: MQTT specifics in mqtt_topics_brokers_and_scale.md; provisioning in device_identity_provisioning_ota.md.
Connectivity protocols and LPWANs
Table of contents
1. Protocol selection 2. MQTT essentials 3. CoAP and HTTP device APIs 4. LoRaWAN 5. Mesh and short-range radios 6. Payload and quality contracts 7. Tradeoffs
Protocol selection
| Factor | Favor MQTT | Favor CoAP | Favor HTTP/REST |
|---|---|---|---|
| Always-on TCP acceptable | Yes | Often UDP | Yes |
| Constrained MCU / UDP | Possible (lightweight stacks) | Yes | Rare |
| Firewalled corporate HTTP only | Bridge via gateway | Proxy/gateway | Yes |
| Pub/sub fan-out to many consumers | Yes | Observe pattern | Polling/webhooks |
| Command/response with low overhead | Yes (request topics) | Yes | Yes |
| Human debugging with curl | Harder | Moderate | Easy |
Default pattern: MQTT from device or gateway to cloud broker; CoAP on constrained UDP links; HTTP for provisioning portals, OTA manifests, and occasional configuration.
MQTT essentials
| Concept | Guidance |
|---|---|
| QoS 0 | Fire-and-forget telemetry; acceptable loss with periodic full state |
| QoS 1 | At-least-once; dedupe at consumer with message id or sequence |
| QoS 2 | Exactly-once; higher overhead—reserve for billing or safety-adjacent commands |
| Retain | Use for last-known config/state topics only; avoid high-cardinality retained storms |
| Last Will Testament (LWT) | Publish offline status; rate-limit fleet-wide LWT alerts |
| Clean session | Prefer persistent sessions for gateways; ephemeral for disposable sensors |
| Keepalive | Set from worst-case NAT timeout; gateways often 30–120s |
Session hygiene: One logical client id per device; reject duplicate connects; document reconnect backoff (exponential cap).
CoAP and HTTP device APIs
CoAP
- Use CON/NON appropriately; confirmable for commands, non-confirmable for high-rate telemetry when loss is acceptable.
- Observe for server-push analog to MQTT subscriptions—watch resource expiry and renewal.
- DTLS mandatory on untrusted networks; pin certs or use EST-like bootstrap aligned with provisioning skill.
HTTP/REST device APIs
- Idempotent PUT/PATCH for desired configuration; ETags for conflict detection.
- Short-lived tokens (OAuth client credentials or device certs) rather than long-lived API keys in firmware.
- Prefer async command pattern:
POST /commands→202+ command id → device polls or uses separate notify channel.
LoRaWAN
| Layer | Responsibility |
|---|---|
| End device | Class A/B/C trade battery vs downlink latency |
| Join | OTAA preferred over ABP; rotate keys via join server policy |
| Network server | ADR, duty cycle, regional parameters (EU868, US915, etc.) |
| Application server | Decode payloads; map to MQTT/HTTP northbound |
Architecture notes:
- Treat LoRaWAN as high-latency, low-bitrate—aggregate at gateway/application server before cloud burst.
- Plan for partial uplinks and duplicate frames; idempotent ingest keys
(devEUI, fCnt, port). - Backhaul from gateway is often Ethernet/LTE/Wi-Fi—coordinate with
wireless-wifi-mobility-specialistwhen Wi-Fi is backhaul.
Mesh and short-range radios
| Radio | Typical role | Edge integration |
|---|---|---|
| Zigbee | Home/building sensors, lighting | Coordinator on gateway → MQTT |
| Z-Wave | Home automation | USB/controller gateway |
| BLE | Wearables, beacons, provisioning | Gateway or phone-assisted onboarding |
| Thread | IPv6 mesh (Matter ecosystem) | Border router on gateway |
Do not design full mesh RF plans here when WLAN/OT specialists own the physical layer—define integration contracts (pairing, trust center, channel plans) and northbound topic mapping.
Payload and quality contracts
Standardize envelopes across transports:
{
"deviceId": "string",
"ts": "ISO-8601 or unix_ms",
"seq": 12345,
"schema": "telemetry.v2",
"data": { },
"meta": { "rssi": -90, "fw": "1.2.3" }
}| Quality dimension | Policy |
|---|---|
| Timestamp | Prefer device monotonic + gateway receive time; flag clock skew |
| Ordering | Per-device sequence; consumers tolerate gaps |
| Duplicates | Idempotent upsert on (deviceId, seq) or cloud message id |
| Units | Document SI units in schema registry |
Tradeoffs
| Goal | Technique | Cost |
|---|---|---|
| Battery life | Long sleep, batch uplink, edge aggregate | Stale telemetry |
| Latency | Class B/C LoRa, QoS1 MQTT, persistent TCP | Power and bandwidth |
| Bandwidth | Binary payloads (CBOR/Protobuf), delta encoding | Debuggability |
| Reliability | Store-and-forward at gateway, QoS1 | Disk and ordering complexity |
| Security | mTLS, DTLS, cert pinning | CPU and provisioning friction |
When users ask for maximum devices per dollar, optimize payload size and connection schedule before broker SKU upgrades.
Device identity, provisioning, and OTA
Table of contents
1. Identity model 2. Provisioning flows 3. Certificate lifecycle 4. Secrets and key storage 5. OTA architecture 6. Rollout and rollback 7. Compliance hooks
Identity model
| Identifier | Scope | Notes |
|---|---|---|
| Manufacturing ID | Factory | Immutable; printed label / secure element |
| Logical deviceId | Cloud registry | Stable across cert rotation |
| Client ID (MQTT) | Broker session | Often equals deviceId; document mapping |
| Certificate SAN/CN | TLS | Short-lived preferred |
| Tenant ID | Multi-tenant SaaS | Embedded in topic prefix and ACL |
Principle: Separate immutable hardware identity from rotatable operational credentials.
Provisioning flows
Factory provisioning
- Inject initial trust anchor or factory cert in secure element.
- Record device in manufacturing DB; export allow-list to cloud registry.
- Seal debug interfaces per product policy.
Field bootstrap (claim)
| Step | Action |
|---|---|
| 1 | Device presents factory cert or one-time claim code |
| 2 | Cloud/registry validates allow-list |
| 3 | Issue operational cert + policy (topics, shadow access) |
| 4 | Revoke or narrow factory credentials |
Zero-touch / bulk
- EST (RFC 7030) or vendor equivalent from gateway.
- CSV allow-list imports for pilots—automate before production scale.
Wi-Fi onboarding: BLE SoftAP or DPP may involve phone apps—coordinate UX with mobile teams; network skill owns resulting MQTT credentials.
Certificate lifecycle
| Phase | Practice |
|---|---|
| Issuance | Short TTL (30–90d devices; 24h high-risk) |
| Rotation | Dual cert window; device connects with either until cutover |
| Revocation | CRL/OCSP or broker deny-list; propagate within minutes |
| Algorithm | ECDSA P-256 or Ed25519 on constrained devices; plan PQ migration |
AWS IoT Core: Register CA, use JITR/JITP templates, attach policies per thing group.
Azure IoT Hub: DPS enrollment groups (symmetric key for dev only), X.509 attestation for production.
Secrets and key storage
| Storage | Suitable for |
|---|---|
| Secure element / TPM | Private keys, attestation |
| Encrypted flash | Operational certs with anti-rollback counters |
| Gateway vault | Per-site secrets; HSM optional |
Never embed long-lived cloud API keys in firmware. Prefer per-device certs or STS-style short tokens brokered by gateway.
Coordinate with embedded-real-time-software-engineer for where keys live in MCU memory and boot chain.
OTA architecture
[Build pipeline] → [Signed artifact in object store]
↓
[Cloud job / IoT Jobs] → [MQTT command or HTTPS manifest URL]
↓
[Device or gateway agent] → verify signature → staged slot → reboot| Component | Responsibility |
|---|---|
| Artifact store | Versioned blobs; CDN for bandwidth |
| Manifest | Version, size, hash, signature, hw compatibility |
| Agent | Download, verify, A/B slots, progress telemetry |
| Policy | Rings, geos, device groups, maintenance windows |
Edge-assisted OTA: Gateway caches firmware for bandwidth-constrained southbound devices (LoRa, serial).
Rollout and rollback
| Ring | Population | Promotion criteria |
|---|---|---|
| Canary | 0.1–1% | Error rate, bricked device count, battery impact |
| Early | 10% | 24–72h soak |
| Broad | remainder | Change window approved |
Rollback triggers:
- Boot loop detection (failed boots counter)
- Connectivity loss threshold post-update
- Safety interlock trips (plant devices—engage OT)
Mechanisms: A/B partitions, signed previous version retained, cloud command to pin version.
Compliance hooks
- Maintain SBOM per firmware line; map CVE response to OTA rings.
- Audit log: who approved ring promotion, artifact hash, device list.
- Data residency: OTA blobs and job APIs in correct region.
- For regulated environments, dual control on production ring promotion.
When legal/compliance owns policy interpretation, implement technical controls only and document evidence artifacts.
Edge gateways and protocol bridges
Table of contents
1. Gateway roles 2. Placement and sizing 3. Protocol bridges 4. Store-and-forward 5. Multi-tenant and isolation 6. Resilience patterns 7. Operations checklist
Gateway roles
| Tier | Examples | Functions |
|---|---|---|
| Field gateway | Industrial PC, LTE router with agent | Southbound protocols, local rules, buffer |
| Home/building hub | Zigbee/Z-Wave coordinator | Pairing, local automation, cloud proxy |
| LoRaWAN gateway | Semtech packet forwarder | RF to UDP/IP; no app logic |
| Edge compute node | K3s, Greengrass, IoT Edge | Containers/modules, ML inference, bridging |
Separation of concerns:
- Radio/PHY — often vendor or WLAN/OT specialist input.
- Bridge/translate — map addresses, scales, and alarms to canonical topics.
- Edge compute — filtering, aggregation, OTA proxy, local actuation with safety interlocks.
Placement and sizing
| Input | Drives |
|---|---|
| Device count per site | CPU, connection table, disk for buffer |
| Message rate and payload size | NIC throughput, serialization cost |
| Southbound protocol count | Bridge containers, serial/USB ports |
| Offline SLA | Disk quota, retention hours |
| Security zone | DMZ vs plant VLAN placement |
Sizing heuristics:
- Reserve 2–5× headroom on connection and msg/s peaks for firmware bugs and burst alarms.
- Disk buffer:
avg_bytes_per_msg × msg_rate × max_outage_hours × safety_factor. - Co-locate gateway one routing hop from southbound segments when latency-sensitive.
Protocol bridges
Common southbound → northbound maps:
| Southbound | Northbound | Notes |
|---|---|---|
| Modbus RTU/TCP | MQTT topics per register map | Poll scheduling, exception codes |
| OPC UA | MQTT or cloud SDK | Subscription vs poll; cert trust stores |
| BACnet | MQTT / REST | Object naming; COV vs periodic |
| CAN / J1939 | MQTT (via telematics stack) | Coordinate with geospatial-telematics-developer for GPS merge |
| BLE GATT | MQTT | Connection churn; proxy through gateway |
| Zigbee ZCL | MQTT | Cluster/attribute to topic template |
Bridge design rules:
1. Single source of truth for tag/register → topic mapping (versioned YAML/JSON). 2. Normalize timestamps at bridge ingress (gateway UTC + optional device offset). 3. Alarm vs telemetry separate topics or severity fields—avoid mixing on same QoS0 firehose. 4. Command path authenticated and auditable; reject unsigned writes in plant contexts. 5. Backpressure — when northbound down, shed lowest-priority telemetry first.
Store-and-forward
| Parameter | Recommendation |
|---|---|
| Persistence | Disk-backed queue; survive process restart |
| Ordering | Per-device FIFO; cross-device unordered acceptable |
| Dedupe | Drop duplicates on replay using seq/id |
| Compression | Batch JSON or use columnar/binary for long outages |
| Sync trigger | Backhaul up + broker ACK + disk below high watermark |
Anti-patterns:
- Unbounded RAM queues — OOM during multi-hour outage.
- Publishing entire history at QoS2 — broker meltdown on reconnect storm.
- No timestamp of record — analytics cannot reconstruct event order.
Multi-tenant and isolation
| Model | Use when |
|---|---|
| Gateway per tenant | Strong regulatory isolation |
| Shared gateway, separate MQTT credentials | Cost-sensitive multi-tenant SaaS |
| Namespace prefix per tenant | Logical isolation on shared broker |
Enforce:
- Separate client certs or username/password per tenant on northbound.
- Filesystem and container namespaces for bridge configs.
- Rate limits per tenant at gateway export.
Resilience patterns
| Pattern | Description |
|---|---|
| Active/standby gateway | VIP or DNS failover; shared disk or replicated queue |
| Dual northbound | Primary MQTT broker + secondary cloud; careful dedupe at consumer |
| Split horizon | Local MQTT bus for plant SCADA; cloud only for aggregated metrics |
| Health gate | Stop northbound publish if local safety PLC heartbeat lost |
Document fail static vs fail safe for command paths with OT stakeholders.
Operations checklist
- [ ] Bridge mapping versioned in Git; CI validates topic collisions
- [ ] Gateway clock synced (NTP/PTP); drift alerts
- [ ] Disk and queue depth metrics with paging thresholds
- [ ] Canary site before fleet config push
- [ ] Runbook for broker cert rotation without mass disconnect
- [ ] Integration test: southbound simulator + northbound mock broker
IoT network and edge scope
Table of contents
1. Purpose 2. Terminology 3. In scope 4. Out of scope 5. Roles and RACI 6. Handoffs
Purpose
Define boundaries for designing and operating IoT connectivity and edge compute layers—from field devices and gateways through brokers, edge runtimes, and cloud IoT control planes.
This skill covers architecture, protocols, provisioning, scale, and operations—not enterprise WLAN RF design, OT plant control security, or pure firmware development without a network story.
Terminology
| Term | Meaning |
|---|---|
| Device plane | Field endpoints, radios, and local buses that originate telemetry and accept commands |
| Edge | Gateways and edge runtimes that aggregate, buffer, translate, and enforce policy close to devices |
| Cloud IoT control plane | Managed services for registry, messaging, shadows/state, rules, and fleet jobs |
| Northbound | Traffic from edge/gateway toward cloud or enterprise systems |
| Southbound | Traffic from devices toward gateway or edge runtime |
| Shadow / twin | Desired vs reported state model for fleet command and drift detection |
| LPWAN | Low-power wide-area networks (e.g. LoRaWAN) optimized for battery and range |
| Protocol bridge | Component that maps one field protocol to another (e.g. Modbus → MQTT) |
| Store-and-forward | Buffer telemetry/commands when backhaul is down; sync on reconnect |
| OTA | Over-the-air firmware or config delivery with staged rollout controls |
In scope
| Area | Examples |
|---|---|
| Application protocols | MQTT (QoS, retain, LWT), CoAP, HTTP/REST device APIs |
| LPWAN and mesh | LoRaWAN architecture, Zigbee/Z-Wave/BLE roles at integration level |
| Gateways and bridges | Protocol translation, edge buffering, multi-tenant gateway isolation |
| Topics and ACLs | Namespace design, shared subscriptions, broker tenancy |
| Identity and PKI | Device certs, EST/bootstrap, rotation, revocation |
| OTA at edge | Rings, bandwidth-aware delivery, rollback, attestation hooks |
| Offline tolerance | Edge queues, disk budgets, dedupe and ordering policy |
| Tradeoffs | Payload size, poll vs push, sleep schedules, edge aggregation |
| Cloud IoT | AWS IoT Core, Azure IoT Hub, GCP IoT patterns; rules and jobs |
| Edge runtimes | Greengrass, IoT Edge modules, K3s edge workloads |
| Segmentation | IoT VLANs/VRFs, broker isolation, zero-trust device access |
| Fleet observability | Connection metrics, shadow drift, LWT storms, broker lag |
Out of scope
| Topic | Route to |
|---|---|
| Enterprise Wi-Fi design, surveys, 802.11k/r | wireless-wifi-mobility-specialist |
| OT Purdue model, ICS protocols as security domain | scada-ics-cyber-security-specialist |
| MCU drivers, RTOS scheduling, bare-metal timing | embedded-real-time-software-engineer |
| BGP/MPLS backbone, peering, DCI | network-backbone-architect |
| SD-WAN overlay and path selection | sd-wan-engineer |
| Cloud landing zone and account factory | cloud-architect |
| General VPC/IaaS without device plane | cloud-engineer |
| Corporate IdP, CSPM program ownership | cloud-security-engineer |
| K8s platform roadmap and developer portal | platform-engineer |
| PostGIS, map matching, geofence APIs | geospatial-telematics-developer |
| ML feature stores and model training | data-scientist / ml-ops-engineer |
Roles and RACI
| Activity | IoT network/edge | Embedded | Cloud/platform | Security | Fleet/product |
|---|---|---|---|---|---|
| Protocol and topic architecture | A | C | C | C | I |
| Gateway/bridge placement | A | C | I | C | C |
| Broker HA and scale plan | A | I | C | C | I |
| Device bootstrap and PKI | A | C | C | A | I |
| OTA rollout policy | A | A | C | C | C |
| Cloud IoT service wiring | A | I | C | C | I |
| IoT VLAN/segmentation design | A | I | C | A | I |
| WLAN RF and roaming | C | I | I | C | I |
| ICS zone and safety instrumented systems | C | C | I | A | I |
Handoffs
| To skill | When |
|---|---|
wireless-wifi-mobility-specialist | IoT uses Wi-Fi as transport—coordinate SSID/VLAN, 802.1X, and density; do not duplicate WLAN design here |
scada-ics-cyber-security-specialist | Devices touch plant networks or safety systems—align zones and change windows |
embedded-real-time-software-engineer | Firmware owns radio stacks and drivers—agree on API contracts and cert storage |
cloud-architect / cloud-engineer | Landing zone, private connectivity, and shared services—IoT owns device plane integration |
cloud-security-engineer | Org-wide guardrails, KMS, and SIEM—IoT implements device-centric controls |
platform-engineer | Edge K8s cluster lifecycle, GitOps, and golden paths for edge tenants |
geospatial-telematics-developer | Location pipelines and spatial APIs—consume normalized telemetry after gateway ingest |
network-backbone-architect | Backhaul/MPLS/DCI for sites—IoT defines bandwidth and QoS needs per gateway |
MQTT topics, brokers, and scale
Table of contents
1. Topic namespace design 2. ACLs and authorization 3. Broker topology 4. Scale patterns 5. Performance and tuning 6. Failure modes 7. Observability
Topic namespace design
Recommended hierarchy:
{tenant}/{env}/{site}/{deviceId}/{stream}/{name}| Segment | Purpose |
|---|---|
| tenant | Multi-tenant isolation |
| env | dev/stage/prod—never share brokers across prod and dev without hard ACL |
| site | Gateway grouping, regional ops |
| deviceId | Stable logical id |
| stream | telemetry |
| name | metric or command verb |
Rules:
- Avoid high-cardinality dynamic segments in shared subscriptions consumers cannot filter.
- Use single-level wildcards (
+) in ACLs; limit#to admin tooling. - Document retained topic allow-list (e.g.
.../config/desiredonly). - Command topics:
.../command/{action}with response on.../command/{action}/response.
Anti-patterns
| Pattern | Problem |
|---|---|
| Topic per sensor field | ACL explosion; broker metadata bloat |
| PII in topic path | Leak in logs and metrics |
| Inconsistent deviceId casing | Duplicate logical devices |
ACLs and authorization
| Principal | Publish | Subscribe |
|---|---|---|
| Device | Own .../{deviceId}/telemetry/#, command responses | Own command topics, config desired |
| Gateway | Site prefix | Site prefix + bridge admin |
| Cloud service | Command desired, fleet jobs | Telemetry ingest wildcards (scoped) |
| Operator tooling | None in prod | Read-only telemetry with audit |
Implementation:
- Prefer certificate CN/SAN → ACL template mapping.
- Use role templates per thing group (AWS policy; Azure hub routes).
- Deny by default; explicit allow per topic subtree.
Broker topology
| Pattern | When |
|---|---|
| Single cluster | <100k connections, single region |
| Active/active cluster | Vendor-supported HA (EMQX, HiveMQ, VerneMQ, cloud managed) |
| Federation/bridge | Cross-region aggregation; watch loop and dedupe |
| Dedicated ingest vs ops | Separate cluster for telemetry firehose vs command path |
Managed options: AWS IoT Core (MQTT endpoint), Azure IoT Hub MQTT, GCP (historical patterns via partners). Self-hosted: EMQX, Mosquitto cluster (limited), HiveMQ.
Scale patterns
| Target | Tactics |
|---|---|
| Millions of devices | Horizontal broker nodes; load balancer TLS termination; shard by tenant/region |
| Connection storms | Exponential reconnect jitter; broker rate limits; onboarding windows |
| Telemetry fan-in | Shared subscriptions on consumer side; partition Kafka/Kinesis from bridge |
| Command fan-out | Job queue + MQTT publish workers; avoid per-device synchronous API |
| Geo distribution | Regional brokers; global control plane; avoid single cross-ocean MQTT hop |
Sharding dimensions:
- By tenant (SaaS)
- By region (data residency)
- By device class (telemetry rate profiles)
Document maximum connections per node from vendor benchmarks with your payload profile.
Performance and tuning
| Knob | Guidance |
|---|---|
| Keepalive | Balance NAT timeout vs false offline |
| Inflight window | Tune for QoS1 throughput without memory blowup |
| Message size cap | Enforce at broker; align with LPWAN MTU after gateway |
| TLS session resumption | Reduce handshake CPU on reconnect storms |
| Persistent sessions | Only where needed; monitor orphaned sessions |
Payload efficiency: Move to CBOR/Protobuf at scale; keep JSON for debug tenants.
Failure modes
| Symptom | Likely cause | Mitigation |
|---|---|---|
| Mass LWT offline | Broker restart, cert expiry, DNS change | Staged cert rotation; canary pool |
| Broker CPU spike | Retained message churn, wildcard subs | ACL tighten; remove rogue # consumers |
| Disk full | Persistent QoS1/2 backlog | Monitor queue depth; scale storage |
| Duplicate telemetry | QoS1 redelivery | Idempotent consumer keys |
| Command stuck | ACL typo after rollout | Policy simulation in CI |
Observability
| Metric | Alert on |
|---|---|
connections | Drop >X% in 5m |
messages_in/out_rate | 3σ deviation |
auth_failures | Spike after rotation |
publish_errors | ACL denials cluster |
consumer_lag | Shared sub group behind |
Tracing: Correlate deviceId, clientId, and cloud messageId where available.
Pair with cloud IoT metrics (see cloud_integration_operations_security.md) for end-to-end SLOs.