BT

InfoQ Software Architects' Newsletter

A monthly overview of things you need to know as an architect or aspiring architect.

View an example

We protect your privacy.

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Register Sign in

Unlock the full InfoQ experience

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources.

Log In

or

Don't have an InfoQ account?

Stay updated on topics and peers that matter to youReceive instant alerts on the latest insights and trends.
Quickly access free resources for continuous learningMinibooks, videos with transcripts, and training materials.
Save articles and read at anytimeBookmark articles to read whenever youre ready.

Logo - Back to homepage

News Articles Presentations Podcasts Guides

Topics

Featured in Development

How to Use Apache Spark to Craft a Multi-Year Data Regression Testing and Simulations Framework

Vivek Yadav, an engineering manager from Stripe, shares his experience in building a testing system based on multi-year worth of data. He shares insights into why Apache Spark was the choice for creating such a system and how it fits in the "traditional" engineering practices.

How to Use Apache Spark to Craft a Multi-Year Data Regression Testing and Simulations Framework

All in development

Architecture & Design

Featured in Architecture & Design

From Confusion to Clarity: Advanced Observability Strategies for Media Workflows at Netflix

Naveen Mareddy and Sujana Sooreddy discuss the evolution of Netflix’s media processing observability, moving from monolithic tracing to a high-cardinality analytics platform. They explain how to handle "trace explosion" using stream processing and a "request-first" tree visualization, and share how to transform raw spans into actionable business intelligence.

From Confusion to Clarity: Advanced Observability Strategies for Media Workflows at Netflix

All in architecture-design

AI Infrastructure

Featured in AI, ML & Data Engineering

Lessons Learned From Building LinkedIn’s First Agent: Hiring Assistant

Karthik Ramgopal and Daniel Hewlett discuss the evolution of AI at LinkedIn, from simple prompt chains to a sophisticated distributed agent platform. They explain the transition to a supervisor-sub-agent model that enables parallel development and modular quality evaluation. and share a blueprint for building resilient, high-scale agentic systems.

Lessons Learned From Building LinkedIn’s First Agent: Hiring Assistant

All in ai-ml-data-eng

Culture & Methods

Featured in Culture & Methods

Changing Power Dynamics: What Senior Engineers Can Learn from Junior Engineers

Beth Anderson discusses the "power distance index" and its critical role in communication. Using the Korean Air Flight 801 tragedy as a case study, she explains the dangers of hierarchy-driven silence. She shares actionable frameworks for building the four stages of psychological safety, implementing reverse mentoring, and using PRs as tools for knowledge sharing rather than gatekeeping.

Changing Power Dynamics: What Senior Engineers Can Learn from Junior Engineers

All in culture-methods

Featured in DevOps

Fix SLO Breaches before They Repeat: an SRE AI Agent for Application Workloads

Bruno Borges discusses a paradigm shift in performance management: moving from manual tuning to automated SRE agents. He explains how to leverage the USE and jPDM methodologies alongside LLMs to reduce MTTR from hours to seconds. By utilizing MCP tools for real-time diagnostics and memory dump analysis, he shares how engineering leaders can scale systems while meeting strict objectives.

Fix SLO Breaches before They Repeat: an SRE AI Agent for Application Workloads

Events

Helpful links

Choose your language

QCon AI New York 2025

Go from AI demos to real engineering impact. Learn to embed LLMs, govern & scale securely.

SOLD OUT!

InfoQ Architect Certification

Join Luca Mezzalira for this 5-week online cohort. Master socio-technical architecture leadership.

Save your spot.

QCon London 2026

Learn what works in AI, architecture, data, security & FinTech.

Early Bird ends Jan 13.

Learn how leading engineering teams run AI in production—reliably, securely, and at scale.

Early Bird ends Jan 13.

InfoQ Homepage Presentations Building Robust Machine Learning Systems

AI, ML & Data Engineering

Building Robust Machine Learning Systems

Reading list

View Presentation

Speed:

Download

43:41

Summary

Stephen Whitworth talks about his experience at Ravelin, and provides useful practices and tips to help ensure our machine learning systems are robust, well audited, avoid embarrassing predictions, and introspectable.

Bio

Stephen Whitworth is a co-founder and machine learning engineer at Ravelin, helping fight fraudsters online. He previously worked at Hailo, where he built data products and simulations to understand how people move around cities. He also started golearn, one of the most popular machine learning libraries for Go.

About the conference

Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.

Recorded at:

Apr 05, 2017

by

Stephen Whitworth

This content is in the AI, ML & Data Engineering topic

Related Topics:

Sponsored Content

BT