Applications os News
The 10 Coolest Big Data Products Of 2017
StreamSets Data Collector Edge
More data being generated today is coming from the edge of IT networks, including Internet of Things devices, IoT sensors in industrial equipment, and the endpoint systems used in cybersecurity applications. The challenge is efficiently collecting all that data.
StreamSets develops a data operations platform for managing the life-cycle of "data in motion." In November the San Francisco-based company debuted StreamSets Data Collector Edge, open-source data ingestion software for resource- and connectivity-constrained systems at the edge of IT networks.
The software is a slimmed-down version of the StreamSets Data Collector product that takes up only 5MB, making it ideal for IoT and cybersecurity edge devices. Today data ingestion logic for such applications is often custom-coded for specific devices.
Based on the Go programming language, SDC Edge supports a range of operating systems including Linux and Android. It performs computations such as data normalization, redaction and aggregation, and is architected to support full-featured edge analytics including machine and deep-learning models.