Incidents & Postmortems
Every incident is a Jira Task labelled incident, and its write-up and postmortem live in that Task's description. Slack is for real-time coordination; the Jira Task is the permanent record. The work an incident produces is tracked in Jira like any other work, linked to the incident Task.
Declaring an incident
Anyone can declare. Lower the bar — over-declaring is cheap, under-declaring is expensive.
- Post in
#incidents:SEV<N>: <one-line summary>. - Open an incident channel:
#inc-YYYYMMDD-<short-name>. - Assign an Incident Commander (IC) — usually the on-call. The IC coordinates; they don't fix.
- Update
#incidentsevery 30 minutes (SEV1) or 60 minutes (SEV2) until resolved. - Create a Jira Task labelled
incidentimmediately, with the postmortem template as its description, and link it in the incident channel. Start filling it in during the incident — don't wait until it's resolved.
During the incident
- IC drives. One person types in the channel; others execute.
- Keep a timeline as you go. Copy-paste timestamps directly into the incident Task.
- If you're stuck for >30 minutes on SEV1, escalate.
Postmortem
- Required for all SEV1 and SEV2. Optional but encouraged for SEV3.
- Drafted in the incident Task's description within 5 business days of resolution.
- Blameless. Focus on the system: "Why did the system make this easy to get wrong?"
- Reviewed with the team; the IC then comments "Postmortem reviewed" and closes the incident Task with that as its reason.
- Action items: maximum 5, each with an owner and due date. Each is filed as a Jira Task labelled
incident-followupand linked to the incident Task.