Bookmarks tagged “tech”
1112 bookmarks tagged “tech”
How LinkedIn customizes Apache Kafka for 7 trillion messages per day | Link
The Log: What every software engineer should know about real-time data's un
I joined LinkedIn about six years ago at a particularly interesting time. We were just beginning to run up against the limits of our monolithic, centralized database and needed to start the transition to a portfolio of specialized distributed systems. This has been an interesting
Big Data Processing at Spotify: The Road to Scio (Part 1) | Labs
This is the first part of a 2 part blog series. In this series we will talk about , a Scala API for and , and how we built the majority of our new data pipelines on Google Cloud with Scio.
Capturing data pipeline errors functionally with Writer Monads | ThoughtWor
As businesses grapple with vast quantities of data, emerging from batch-based and streaming sources, it’s truly exciting to see the dominant data processing frameworks embrace the Kappa Architecture, that unifies batch and stream processing. With Kappa Architecture, the batch pro
The State of Cryptocurrency Mining - The Sia Blog
For those new to the blog, I am the lead developer of Sia, a blockchain based cloud storage platform. About a year ago, myself and some members of the Sia team started Obelisk, a cryptocurrency ASIC…
Chernobyl DevOps: Software Engineering, Disaster Management, and Observability
Or at least, that’s the story that operators working for FirstEnergy in a power substation in Wadsworth, Ohio, just a few miles southwest of Akron, had in front of them. All systems seemed…
Changing Lanes - Becoming a Platform Product Manager - Mind the Product
I’m a product manager for a content management system that runs some of the most-visited websites in the world. Our team reports to the CTO, and we sit within the engineering arm of the organization. Prior to this I’d had a year’s product experience at a customer-facing SaaS comp
Product management in infrastructure engineering.
Recently a bunch of teams I work with have turned the corner, having paid down technical debt to a long-term sustainable level. The future unfurls with possibility. Many of the infrastructure engineer teams I’ve been a part of have struggled to make the transition from maintenanc
Stop Trying to Delight Your Customers
To really win their loyalty, forget the bells and whistles and just solve their problems.
Testing in Production: the hard parts - Cindy Sridharan - Medium
There’s a fair bit of chatter about the virtues of testing in production these days. I’ve myself written about this topic over a year ago. This post isn’t so much of an argument as to why one should…
Testing in Production, the safe way - Cindy Sridharan - Medium
In this post, I hope to explore different forms of “testing in production”, when each form of testing is the most beneficial as well as how to test services in production in a safe way. However…
Accelerate - Building and Scaling High Performing Technology Organisations
I first read Accelerate by Nicole Forsgren, Jez Humble, Gene Kim back in 2018 when it was a hot topic in the office; only an hour or two would go by between overhearing somebody talk about it, internal blog posts were being written, and we’d receive emails about following the fin
Pando: Move fast, break things: The sad story of Platform, Facebook’s gigan
Democratizing career progression
Strong Opinions Loosely Held Might be the Worst Idea in Tech - The Glowforg
Meet Glowforge, the 3D laser printer that makes magical things at the push of a button.
The problem with ‘5 whys’
‘The Problem with…’ series covers controversial topics related to efforts to improve healthcare quality, including widely recommended but deceptively difficult strategies for improvement and pervasive problems that seem to resist solution. The ‘5 whys’ technique is one of the mo
How Postgres Makes Transactions Atomic
A dive into the mechanics that allow Postgres to provide strong atomic guarantees despite the chaotic entropy of production.
Open Banking in the UK: what's happened so far | 11:FS Pulse
Since January 2018, we have heard a lot about Open Banking, the regulation that has released the financial data of consumers from the banks’ ownership and into the hands of consumers. The short answer is “Yes, a lot has changed.” It took us over a century to build the mess that w
Liberating Structures - Introduction
liberating structures, social invention.net, microstructures, disruptive innovation, behavior change, collaboration, social invention, diffusion of innovation, strategy, transformation, heuristics, complexity science, emergence
You should not run your mail server because mail is hard - poolp.org
TL;DR: - Mail is not hard: people keep repeating that because they read it, not because they tried it - Big Mailer Corps are quite happy with that myth, it keeps their userbase growing - Big Mailer Corps control a large percentage of the e-mail address space which is good for non
Ten Principles for Growth as an Engineer - Dan Heller - Medium
A brief list of practices for maturing as a software engineer.
How to do a code review | eng-practices
Google’s Engineering Practices documentation
I test in prod – Increment: Testing
Testing in production is a superpower. It’s our inability to acknowledge it that’s the trouble.
Agile Software Guide
Agile software development is an approach designed to build software for uncertain and changing needs.