Emanuele-Della-Valle,-PhD

Vijeta Hingorani

Technical Platform Owner, Socialgist

Vijeta is a Technical Platform Owner working for Socialgist. She is currently leading the migration of products on-prem Kubernetes platform and helping the team build a reliable platform by driving the Choas Engineering effort. Prior to leading the platform, she has been a Full-Stack developer with expertise in Nodejs. She is passionate about making engineering organizations more effective by introducing standards and best practices.

Apart from the tech side, Vijeta enjoys watercolor painting and kayaking in Michigan’s beautiful natural lakes.

Talk Title:  Transforming Email Reports into Self-Serving Dashboards & Detecting Anomalies In-Stream

The first project profiled in this talk (transforming email reports into self-serving dashboards) involved generating query-based reports for the sales team replacing email reports. Messages were consumed from Apache Kafka, aggregated and inserted into InfluxDB based on Kafka metadata timestamp. The Socialgist team ran into a problem of counts mismatch for high-traffic Kafka topics and solved it by randomizing timestamp and building cache.

The second project profiled (detecting anomalies in-stream) involved detecting strange behaviors in graphs of data streams (that are internally considered as anomalies). Data is pulled from Elasticsearch, run through the anomaly detection model, and stored in InfluxDB. The results stored in InfluxDB are represented in Grafana, and alerts are fired into the Slack channel. This project helped Socialgist predict the behaviors of streams and identify alerts before any other system could.