Financial Infrastructure · DevOps · Boston

Engineering inside
financial services.

Ten years across private equity, retail, and asset management. Real technical experience covering infrastructure, cloud, security, and trading systems. Written plainly to help other engineers navigate this world.

Michael Harlow
Michael Harlow // sys.ghost  ·  Boston, MA
☕ Buy me a coffee
Latest post
Every engineering org I talk to is running AI agents somewhere in production now. Almost none of them have figured out how to operate them the way we operate everything else that touches customer data.
Jul 14, 2026 · 11 min read
Read →
Latest post
Every engineering org I talk to is running AI agents somewhere in production now. Almost none of them have figured out how to operate them the way we operate everything else that touches customer data.
Jul 14, 2026 · 11 min read
Read →
All posts

Archive

We scheduled a Technology Connect event for our engineering team and built a lineup of games around AI and infrastructure topics. Here's how we put it together and what I'd do differently.
← Back to posts
Infrastructure June 7, 2026 · 11 min read

Incident Communication in Financial Services: What I Say, What I Don't, and Why

Incident Communication in Financial Services: What I Say, What I Don't, and Why

There is a scene that plays out in financial services firms during an incident that does not appear in any SRE handbook I have read. The technology team is working the problem. The trading floor has noticed. Someone from the business has walked into the room, or sent a message, or, if it is bad enough, physically stood behind an engineer's chair. And the question they are asking is not "what happened" or "what are you doing about it." The question is "are we going to breach SLA."

That question has legal implications. It has client reporting implications. It has regulatory implications. The answer you give in that moment, even informally, can end up in an incident log that gets reviewed by compliance, or in a client communication that gets sent under a lawyer's name, or in a regulatory filing.

This is the part of incident communication that most guides skip. They were written for consumer tech companies where the blast radius of a badly worded status page is brand damage. In financial services, it can be something more concrete than that.

Who You Are Actually Talking To

When I run an incident in a consumer tech context, my audience is roughly: engineers, their managers, and end users via a status page. The communication chain is short.

In asset management, the stakeholder map looks different. There is the technology team. There is IT leadership. There is the business: trading, portfolio management, operations, client services. There is compliance. There is legal. There is, depending on the severity, risk management and the CTO or CIO. And depending on what systems are affected, there may be clients and their own legal and compliance teams on the other end of a phone call.

Each of those audiences wants different things from you, on different timescales, at different levels of technical detail. Getting this wrong (telling the trading desk something you haven't cleared with compliance, or giving the client services team a technical explanation they will relay inaccurately) creates problems that outlast the incident itself.

The first thing I do in any significant incident is answer two questions before I write a single communication: who needs to know, and what are they actually asking?

The First Five Minutes

The first communication in an incident is the most important because it sets the frame. Get it right and you establish that the situation is in hand. Get it wrong and you spend the rest of the incident correcting the impression.

My rule for the first five minutes is: communicate that you are aware of the issue, that you are investigating, and that you will give an update by a specific time. Nothing more.

This sounds obvious. It is harder than it sounds. The pressure in the first few minutes of an incident is to demonstrate that you know what is happening. That pressure pushes people toward speculating in their communications: saying "this looks like a database issue" when they don't yet know, or "we should be back up within the hour" when they have no basis for that estimate.

Speculation in incident communications causes specific problems in financial services. If you tell the business "looks like a database issue" and it turns out to be a network problem, you have created a false record and wasted time on their end while they prepared for a database-related impact. If you tell client services "we should be back up within the hour" and you are not, you have given them a commitment to a client that you then have to walk back.

The correct first message is boring: "We are aware of an issue affecting [system]. We are investigating. Next update at [specific time]." That is all. The specific time should be no more than 30 minutes away, because that forces you to actually have something to say by then.

Separating What You Know from What You Think

This is the discipline that takes practice. When you are inside an incident, your brain is pattern-matching aggressively. You have seen similar symptoms before. You have a theory. The theory feels like knowledge.

It is not knowledge. It is a hypothesis.

In incident communications, I use explicit language to separate these. "We know that X is happening" versus "we believe the cause is Y, and we are investigating." That distinction matters because the people receiving your communication will act on it. If I tell the trading desk that we know the cause is a failed index on the orders table, they will make decisions based on that. If I turn out to be wrong, those decisions were made on false information.

The format I use for mid-incident updates:

What we know: Factual observations only. Service is unavailable. Error rate is X%. This started at HH:MM.

What we believe: Current hypothesis. We believe this is related to [thing]. This is not confirmed.

What we are doing: Specific actions being taken right now. Not "investigating"; that tells people nothing. What specifically are you checking?

Next update: Time. Always a specific time.

I enforce this format in major incidents because it forces the person writing the update to actually separate fact from hypothesis in their own head before they communicate it externally.

The Things You Do Not Say

There are things you do not put in incident communications in financial services, and most of them are things that would be fine to say in a different industry.

You do not speculate about root cause until you know it. This is harder to enforce than it sounds because stakeholders push for it. The business wants to know why. Your honest answer in the first 30 minutes of a complex incident is "we don't yet know," and that is the answer you should give.

You do not give time estimates unless you have a specific basis for them. "We hope to have this resolved in an hour" is not a time estimate. It is a wish. What you can say is "we are deploying a fix now and expect it to take 20 minutes to roll out." That is a real estimate with a real basis.

You do not use language about financial impact, SLA breach status, or contractual obligations in technical communications. Those determinations belong to specific people in specific roles. If someone from the business is in your incident channel asking whether you are going to breach SLA, the correct answer is "I'll get you connected with the right people on that," not an off-the-cuff technical opinion that gets forwarded to a client.

You do not comment on whose fault it is, in any direction. Not "the vendor's API went down," not "a change made by [team] caused this." Root cause and accountability are for the post-mortem. In the incident, what matters is resolution, and blame in communications, even accurate blame, consumes energy that should be going toward resolution.

Communicating Across Technical Levels

The same incident looks completely different to an engineer and to a portfolio manager. The engineer wants to know what systems are affected, what errors are appearing, what the current hypothesis is, and what work is in progress. The portfolio manager wants to know whether they can trade, what the impact is on specific workflows, and when it will be resolved.

I maintain two communication streams in major incidents. One is the technical channel: the incident call, the engineering Slack, the internal runbook. The other is the business-facing update, which I write separately and send to a distribution list that includes business leadership, IT leadership, and client services.

The business-facing update never contains stack traces, error messages, infrastructure topology, or technical hypotheses. It contains: what is not working, who is affected, what the impact is in business terms, and what the next update time is. If I am going to say anything about cause, I wait until I am certain, and even then I keep it at the level of "a component in the [X] system failed" rather than "the Kafka consumer group lost its offset."

Writing this second communication while an incident is active is genuinely hard. It requires translating from engineering language into business language under time pressure, and it requires doing so accurately enough that the business can make real decisions from it. I have gotten better at this over time, and the thing that helped most was reading back through old incident communications and noting the places where the business-facing update was technically accurate but operationally useless.

The Compliance Dimension

Financial services firms have compliance obligations that affect incident communication in ways that are worth understanding explicitly.

Many firms are required to maintain incident logs that can be reviewed by regulators. What goes into those logs matters. Informal communications (a Slack message, a hallway conversation, an email from an engineer) can become part of the record in a regulatory inquiry if they contain information about the incident. This is not a reason to go silent during incidents. It is a reason to understand that what you write in work communications is not private and may be reviewed by people outside the firm.

Depending on the firm and the type of incident, there may be regulatory reporting obligations. A material operational incident at a regulated investment manager can trigger reporting requirements to bodies like the FCA, SEC, or FINRA depending on jurisdiction and nature of the incident. These reports go out under legal and compliance sign-off, not engineering. But the information in them comes from engineering. The incident log you maintain, the timeline you document, the cause analysis you complete: these feed directly into regulatory reporting.

The implication is that incident documentation needs to be accurate, timestamped, and complete. Not because of bureaucracy. Because it becomes the record.

The Post-Incident Communication

The incident is resolved. The all-clear goes out. Most communication stops at this point, and that is a mistake.

The post-incident communication, not the internal post-mortem but the external-facing summary, is one of the most important things you can write. Done well, it demonstrates competence and accountability. Done badly, it either sounds defensive or creates new concerns.

The structure I use:

What happened: A factual description of the incident in plain language. When it started, what the impact was, when it was resolved. No jargon, no hedging.

Why it happened: Root cause, at a level of detail appropriate for the audience. For internal distribution, this can be technical. For client-facing communication, it should be at the business system level.

What we're doing about it: Specific remediation actions. Not "we are reviewing our processes." What specifically is changing? What specific failure is being addressed? Give a timeline for those actions if you have one.

This last section is the one firms usually get wrong. The tendency is to be vague, because specific commitments create accountability. But vagueness reads as not taking the incident seriously, and stakeholders notice that. If the cause was a failed disk in a storage array that should have been flagged for replacement six months ago, the remediation is: we are replacing the disk, we are reviewing the replacement schedule for similar hardware, and we are adding an alerting rule for SMART data so this gets caught earlier. That is specific. That is what confidence looks like.

What This Has Taught Me

I have been involved in enough incidents in this industry to have learned some of this the hard way. I sent a communication early in my career that included a time estimate I had no basis for. The estimate was wrong. The client services team had already told a client. That conversation with the client services lead afterwards was not a good one.

I have also seen incident communications done well, by people who were calm under pressure, specific in their language, and honest about what they did and did not know. Those incidents, even the bad ones, ended with relationships intact and sometimes stronger. The competence demonstrated under pressure built trust.

The tooling does not really matter. Whether you use PagerDuty or Statuspage or an internal tool or a shared document, the fundamentals are the same. Know your audience. Separate fact from hypothesis. Be specific about what you know and what you don't. Give time commitments and keep them. Don't speculate about things you can't know yet.

The hardest part of all of this is not the writing. It is the discipline to slow down enough to do it right when the pressure is high and the instinct is to say everything you are thinking as fast as you can. That discipline is learnable. It just takes practice, and, unfortunately, incidents.

Found this useful?
☕ Buy Michael a Coffee
← More posts

Hey, I'm Michael Harlow.

Senior Systems Engineer · Boston, MA · Writing as sys.ghost

I have spent over a decade building and maintaining infrastructure at the intersection of technology and financial services. My career has taken me through three distinct sectors -- technology, private equity, and asset management -- and each one changed how I think about what reliable infrastructure actually requires.

I started in general IT, which is where most engineers who did not go straight into software end up. Data centers, networking, on-call rotations, learning to label cables properly because unlabeled cables are a promise that someone else will suffer later. The work taught me that almost every sophisticated system is, one layer down, a collection of unglamorous fundamentals that either hold or do not. I still believe that. I still label everything.

Private equity came next, and it was a different world. The infrastructure stakes there are less about uptime and more about data integrity. When deal teams are making acquisition decisions based on data you are responsible for, and when a due diligence process has a hard deadline that does not move regardless of what broke overnight, your relationship with reliability changes. A wrong number in an LP report does not cause an immediate incident. It causes a conversation in a partner meeting six weeks later, and by then you need to reconstruct what happened from imperfect records. I became obsessive about data provenance in PE and I have not stopped.

For the past several years I have been in asset management, supporting trading and investment operations infrastructure. This is the environment I find most technically interesting. The compliance requirements are demanding, the legacy systems have long institutional memories, and the tolerance for operational errors is genuinely low -- not just in terms of business impact, but in terms of regulatory consequence. When markets are open, there is no fixing it after the weekend.

I started Packet & Profit in January 2026 because I kept looking for the kind of writing I wanted to read and finding it mostly did not exist. There is a lot of content for engineers online. There is much less written by engineers working specifically inside regulated financial services firms, being honest about what that actually involves day to day. The compliance conversations, the legacy constraints, the incident management in front of stakeholders who measure downtime in dollars per minute. That is what I write about here.

Outside of work I have been running a Saturday morning robotics course at my local YMCA for kids aged 10 to 14. It is one of the better decisions I have made.

Certifications

Red Hat Certified Engineer (RHCE)
Certified Kubernetes Administrator (CKA)
AWS Solutions Architect -- Associate
CompTIA Security+
HashiCorp Vault Associate

My Stack

RHEL / Ubuntu
Kubernetes
OpenShift
Terraform
Ansible
Prometheus
Grafana
Python / Bash
AWS / Azure
Cisco / Palo Alto
PostgreSQL
Redis
HashiCorp Vault
Fluent Bit
Helm
ArgoCD

Career

2022 -- Present
Senior Systems Engineer, Asset Management -- Boston, MA
Leading infrastructure for trading operations and investment management systems. Responsibilities span network security, cloud migration strategy, Kubernetes platform engineering, and incident response. Deeply involved in T+1 settlement infrastructure work and the shift from overnight batch processing to near-real-time event-driven architecture.
2018 -- 2022
Systems Engineer, Private Equity -- Boston, MA
Built and maintained data infrastructure supporting deal teams, portfolio monitoring, and investor reporting. Managed infrastructure through multiple due diligence cycles with hard deadlines and high data integrity requirements. Led a major data platform migration from on-premises to cloud-hosted infrastructure, including security controls satisfying LP and regulatory requirements.
2015 -- 2018
Infrastructure Engineer, Retail Technology
Supported inventory management, real-time pricing, and supply chain integration systems across a high-SKU retail environment. Operated under peak load conditions where scale was a concrete engineering problem rather than an abstract one. Built out monitoring and alerting infrastructure from scratch and managed a full data center relocation.
2013 -- 2015
IT Engineer, Technology Sector
Established the professional fundamentals: data center operations, network infrastructure, endpoint management, and the on-call rotations that teach you more about system fragility than any textbook. Developed an appreciation for cable labeling that has never left me.

Get in Touch

If you are an engineer working in financial services, curious about the career path, or have a question about something I have written, I would genuinely like to hear from you. Use the and I will get back to you. If something here has been useful, a coffee is always appreciated.

A note on anonymity: I write under my own name but keep my current employer private. The financial services industry is small, the regulatory environment is real, and I want to write honestly without those constraints. All incidents and case studies on this site are anonymised. The technical content is real; identifying details are not.
Get in touch

Contact

Whether you are an engineer in financial services, have a question about something I have written, or just want to say hello - feel free to reach out. I read everything.

Powered by Resend · No spam, ever

Legal

Privacy Policy

Last updated: April 2026

This policy explains what information Packet & Profit collects when you visit this site, how it is used, and what choices you have.

Information We Collect

We do not require you to create an account or provide personal information to read this blog. The only personal information we collect is what you voluntarily submit through the contact form: your name, email address, and message. This information is transmitted via Resend and used solely to respond to your enquiry.

Google AdSense and Advertising

This site uses Google AdSense to display advertisements. Google AdSense uses cookies and similar tracking technologies to serve ads based on your prior visits to this and other websites. This means Google may use information about your visits to this site to show you personalised ads on other sites across the web.

You can opt out of personalised advertising by visiting Google Ads Settings, aboutads.info, or optout.networkadvertising.org. See Google advertising policies for more.

Cookies

This site uses a single first-party cookie to remember your theme preference (light or dark mode). This cookie contains no personal information. Third-party cookies may be set by Google AdSense for advertising purposes as described above.

Analytics

This site does not currently use any analytics platform beyond what Vercel provides as part of its standard hosting service (aggregated, anonymised traffic data).

Contact Form

When you submit the contact form, your name, email address, subject, and message are transmitted to the blog author via Resend. This data is not stored by this site and is not shared with any third party beyond Resend. See Resend's privacy policy for details.

Third-Party Links

Posts on this site may link to external websites. We are not responsible for the privacy practices or content of those sites.

Your Rights

If you have submitted a message via the contact form and would like that information removed, or if you have any questions about this policy, please use the contact form to get in touch.

Changes to This Policy

We may update this policy from time to time. The date at the top of this page reflects when it was last revised.

Legal

Terms of Service

Last updated: April 2026

By accessing and using Packet & Profit (packetandprofit.com), you agree to be bound by these Terms of Service. If you do not agree, please do not use this site.

Use of Content

All written content, illustrations, and code examples published on this site are the original work of Michael Harlow unless otherwise stated. You are welcome to share links to posts and quote brief excerpts (with attribution), but you may not reproduce full articles, copy content to other websites, or use the content for commercial purposes without written permission.

No Professional Advice

Content published on this site reflects personal opinions and professional experience. It is provided for informational and educational purposes only. Nothing on this site constitutes financial, investment, legal, or professional advice of any kind. See the for more detail.

Third-Party Links

This site may contain links to third-party websites. These links are provided for convenience and do not constitute an endorsement of the linked site or its content. We have no control over and accept no responsibility for external sites.

Advertising

This site participates in Google AdSense, which displays advertisements from third-party advertisers. The presence of an advertisement does not constitute an endorsement of the advertiser's products or services. Ad content is determined by Google based on the content of this site and your browsing history.

Accuracy of Information

While we make every effort to ensure the accuracy of information published on this site, technology and financial markets change rapidly. Information that was accurate at the time of publication may become outdated. We do not warrant the completeness, accuracy, or timeliness of any content on this site.

Limitation of Liability

To the fullest extent permitted by law, Packet & Profit and its author shall not be liable for any direct, indirect, incidental, or consequential damages arising from your use of, or inability to use, this site or its content.

Changes to These Terms

We reserve the right to update these terms at any time. Continued use of the site following any changes constitutes your acceptance of the revised terms. The date at the top of this page reflects the most recent revision.

Contact

If you have questions about these terms, please use the .

Legal

Disclaimer

Last updated: April 2026

Packet & Profit is a personal blog written by Michael Harlow, a Systems Engineer based in Boston, MA. The views expressed here are entirely his own and do not represent those of any employer, client, or organisation he is affiliated with.

Not Financial or Investment Advice

This site discusses financial services technology, investment management infrastructure, and related engineering topics from a technical practitioner's perspective. Nothing published here is financial advice, investment advice, or a recommendation to buy, sell, or hold any security, asset, or financial instrument. The author is not a registered financial adviser, broker, or investment professional.

Content that references financial markets, trading systems, or investment firms is provided for technical and educational context only. Any figures, case studies, or examples are illustrative and should not be relied upon for financial decisions.

Not Legal or Professional Advice

Nothing on this site constitutes legal, compliance, regulatory, or professional advice. Readers should consult qualified professionals for advice specific to their circumstances.

Professional Experience

Posts on this site draw on the author's professional experience in systems engineering across private equity, retail technology, and asset management. Specific details about employers, clients, projects, and colleagues have been anonymised or generalised. Any resemblance to specific organisations is incidental.

Accuracy

The author makes reasonable efforts to ensure published information is accurate at the time of writing. The technology and financial services landscape changes quickly. Readers should verify any technical or regulatory information against current primary sources before acting on it.

Affiliate Links and Advertising

This site displays advertisements through Google AdSense. The site may also contain links to tools, services, or products that the author uses or finds useful. These are not paid endorsements unless explicitly stated. The author's opinions are his own and are not influenced by advertisers.

Questions

For questions about anything on this site, please use the .

This site uses cookies for theme preferences and displays ads via Google AdSense, which may use cookies to personalise ads.