
The 3 levels of AWS observability
Hey ๐๐ฝ
This week I'm bringing back one of our most-read posts: the 3 levels of AWS observability. A lot of you joined after it went out in May, and the topic fits this week perfectly.
Because the real question isn't "do I have logs?" anymore. It's "who actually knows what they mean?" ๐๐ฝ
What if the junior on call knew what your senior knows?
In most teams, one senior engineer knows which alert matters. "Ignore that one, it fires every Tuesday." "That's the DB again." When that person is on vacation, everybody else sorts by severity and hopes for the best.
Dynatrace built an open-source app for Kiro Crew, AWS's always-on agent workspace. It puts your production problems on a board, and an agent ranks them by recurrence, root cause and blast radius, with one line on why. "Investigate" opens a chat with the evidence already loaded, and the whole thing is read-only.
You can run it locally on demo data, no account needed.
Sponsored by Dynatrace. These are my own words.
๐ From the Archive
In 2022 I joined a startup with 100 million API requests a month. All on AWS, all logs in CloudWatch. I loved it. Then the first incident hit. My boss was looking over my shoulder, and I didn't even know which log stream to open. As a self-claimed AWS expert. Level 1: Log HellWe had logs, metrics and some traces. All unstructured plain text, spread over different log streams. When a customer reported a missing order, we searched strings and compared timestamps by hand. You cannot skip a levelOver the years I went through three levels of AWS observability. Each one builds on the one before. Most teams stop at Level 2, and that is the level that makes everything after it possible. Level 3 is where I stopped opening the console. What does it take to get there, and why does it fail without Level 2? |
๐ฐ This Week in AWS๐AWS Lambda Web Functions
๐CloudWatch log routing and chained parsers
๐Lambda loop detection for EventBridge custom buses
|
That's it for this week.
Where is your team right now: Level 1, 2 or 3? Hit reply and tell me, I read every answer.
See you next week,
Sandro & Tobi