Logging and Monitoring Procedure

What the Organisation logs for each class of system, how logs are protected and retained, how often they are reviewed and what triggers an alert.

SXL-B11Procedure2,044 words 9 min readOwner: Head of IT Security
Sign in to download the PDFFree. You return straight to this document after you sign in.
Template draft. Replace everything in [square brackets] with your own decision, delete what does not describe what you really do, and approve it through your own document control. It is not legal advice and does not make an organisation compliant or certified.

1. Purpose

This procedure sets out how the Organisation records events on its systems, protects those records, reviews them and acts on what they show. Its aims are to detect misuse and attacks early, to prove who did what and when, to support investigations and legal requests, and to demonstrate that controls operate. It implements the Logging and Monitoring Policy.

2. Scope

  • In scope: all servers, endpoints, network and security devices, databases, applications, identity systems, cloud services and customer-facing platforms that store, process or transmit Organisation or customer information.
  • In scope: administrative and privileged activity, remote access, physical access systems, backup and recovery tools, and the logging and monitoring tools themselves.
  • Out of scope: the content of personal communications beyond what the Acceptable Usage Policy allows, and logs held entirely by customers on systems the Organisation does not operate. Where the Organisation relies on a supplier's logs, the Supplier Relationship Management Procedure governs access to them.

3. Terms and Definitions

TermMeaning
EventAny observable occurrence on a system, such as a login, a file change or a service restart.
LogA time-stamped record of an event kept in a file, database or logging platform.
SIEMA security information and event management tool that collects, correlates and alerts on logs.
Log sourceA system or device that produces logs and is registered for collection.
AlertA notification produced when a rule, threshold or analyst judgement indicates a possible security issue.
BaselineThe normal pattern of activity for a system, used to spot unusual behaviour.
Time sourceThe trusted clock to which all systems are synchronised, so that events can be ordered across systems.

4. Roles and Responsibilities

RoleResponsibilities
Document owner (Head of IT Security)Owns the logging standard, the log source register and the alert rules; reports measures [monthly].
Security operations teamOperates the SIEM, tunes rules, triages alerts within the target times, escalates incidents and performs scheduled log reviews.
System ownersEnsure each system in their care is registered, produces the required events and is not changed in ways that disable logging.
IT operations and platform teamsConfigure log forwarding, time synchronisation, storage and backup of logs; fix collection failures within [1 working day].
Application development teamsBuild applications that log security events as required, without writing secrets or unnecessary personal data into logs.
Data protection officerReviews log content for personal data minimisation and approves access to logs that identify individuals.
Internal auditChecks independently that logs are complete, protected and reviewed as stated.
ActivityResponsibleAccountableConsultedInformed
Register a new log sourceSystem ownerHead of IT SecuritySecurity operationsIT operations
Configure forwarding and time syncIT operationsHead of IT OperationsSecurity operationsSystem owner
Triage and respond to alertsSecurity operationsHead of IT SecuritySystem ownerIncident manager
Perform periodic log reviewSecurity operationsHead of IT SecuritySystem ownerInternal audit
Approve access to raw logsHead of IT SecurityChief Information Security OfficerData protection officerLine manager
Respond to a legal or regulator request for logsHead of IT SecurityChief Information Security OfficerLegalSenior management

5. System Classes

Systems are placed in one of three classes by the sensitivity of what they hold and their role in the business. The class sets how much is logged, how long it is kept and how often it is reviewed. The owner records the class in the log source register (Annexure A).

ClassDescriptionExamples
Class 1: CriticalHolds Confidential or Restricted data, or is essential to customer service or security.Customer-facing platforms, production databases, identity directory, key management, firewalls, VPN, privileged access tool.
Class 2: ImportantSupports internal operations or holds Internal data.Email, file servers, collaboration tools, ticketing tool, endpoint management.
Class 3: StandardLow impact systems and endpoints.User laptops, printers, test environments with no real data.

6. What Is Logged

The following minimum events are recorded. System owners may log more but may not log less without a recorded exception. Each record must carry at least the date and time (with time zone), the source system, the user or service identity, the action, the object affected, the outcome and the source address where one exists.

Event typeClass 1Class 2Class 3
Successful and failed authenticationYesYesYes
Privileged account use, role and permission changesYesYesWhere supported
Account creation, change, disable and deletionYesYesWhere supported
Access to Confidential or Restricted data (read, export, delete)YesWhere supportedNo
Changes to configuration, security settings and audit settingsYesYesWhere supported
Start and stop of logging, and log clearingYesYesWhere supported
Network connections allowed and denied at boundariesYesYesNo
Remote access sessionsYesYesYes
Malware and endpoint protection detectionsYesYesYes
Application errors, input validation failures, transaction failuresYesWhere supportedNo
Use of administrative utilities and scheduled jobsYesWhere supportedNo
System start, shutdown, crash and resource exhaustionYesYesWhere supported
Physical entry to secure areasYesYesn/a
Note. Do not write passwords, keys, tokens, payment card numbers or full personal records into logs. Mask or hash them before they reach the logging path. Application teams check this during design review and testing.

7. Time Synchronisation

All systems synchronise to the Organisation's approved time sources, which in turn use at least [two] independent reference sources. Clock drift beyond [one second] on Class 1 systems raises a ticket; the time zone and format are the same everywhere that logs are collected.

8. Collection, Protection and Retention

8.1 Collection and integrity

  • Class 1 and Class 2 sources forward logs in near real time to the central logging platform; local copies are kept only for the buffer period of [24 hours].
  • Logs are transmitted over encrypted channels where the platform supports them and are time-stamped on receipt.
  • Write access to logs is limited to the collection service. Administrators of source systems must not be able to edit or delete their own logs on the platform.
  • The central platform records every access to its contents, including searches and exports of raw data.
  • Integrity checks (hashing or write-once storage) are applied to Class 1 logs and verified [monthly].
  • Loss of log flow from a Class 1 source for more than [15 minutes] raises an alert; for Class 2, [4 hours].

8.2 Retention

Retention is the longer of the periods below, any contractual obligation to a customer, and any legal hold. Logs of systems operated in India are stored within Indian jurisdiction. The CERT-In Directions of 28 April 2022 require ICT logs to be kept for 180 days within Indian jurisdiction [confirm the current requirement].

Log typeOnline and searchableArchiveTotal
Class 1 security and authentication logs[180 days][until 12 months total][12 months]
Class 2 logs[90 days][until 6 months total][6 months]
Class 3 logs[30 days]None[30 days]
Privileged activity and audit-setting changes[180 days][until 24 months total][24 months]
Physical access logs[90 days][until 12 months total][12 months]
Logs under legal hold or incident investigationAs requiredAs requiredUntil released by legal

8.3 Access and disposal

  • Access to raw logs is by role and approved in the ticketing tool; analysts use read-only roles.
  • Logs that identify individuals are used only for security, operations, audit and legal purposes; use for staff performance review requires HR and the data protection officer to approve.
  • Expired logs are deleted automatically by the platform and the deletion jobs are checked [quarterly].
  • Logs needed as evidence are exported with a hash and handled as described in the Incident Management Procedure.

9. Monitoring and Alerting

9.1 Alert priorities and response

PriorityExampleAcknowledge withinInitial response withinEscalation
CriticalConfirmed malware on a Class 1 system, administrator login from an unexpected country, log source tampering.[15 minutes][1 hour]Incident manager and Head of IT Security immediately.
HighRepeated failed logins against privileged accounts, outbound traffic to a known malicious address, large data export.[30 minutes][4 hours]Security lead; incident manager if confirmed.
MediumPolicy violation, new admin account outside change window, disabled endpoint protection.[4 hours][1 working day]System owner informed.
LowSingle failed login, informational anomaly.[1 working day][5 working days]Reviewed in the weekly summary.

9.2 Minimum alert rules

  • Multiple failed logins followed by a success for the same account within [10 minutes].
  • Use of a privileged account outside approved hours or from a new location or device.
  • Creation of accounts, role changes or group membership changes outside a recorded request.
  • Disabling or clearing of logs, audit policies, endpoint protection or monitoring agents.
  • Access to Restricted data by an account that has not used it in the last [90 days].
  • Unusually large data transfers out of the network, or uploads to unapproved storage.
  • Communication with addresses or domains on threat intelligence lists, as supplied under the Threat Intelligence Policy.
  • Vulnerable or end-of-life software detected on Class 1 systems.
  • Physical access to a secure area outside the person's usual hours without a matching approval.

9.3 Tuning

The security operations team reviews rules [monthly] for false positives and gaps, using incident outcomes, penetration test findings and new threat intelligence. Every rule change is recorded with the reason, tested before use and approved by the Head of IT Security for Critical and High rules.

10. Log Review Procedure

  1. PrepareThe analyst lists the sources due for review from the schedule below and confirms that collection was complete for the period. Output: review checklist.
  2. ReviewLook for the minimum alert patterns, accounts with unusual activity, new administrators, changes to audit settings, failed backup or patch jobs, and gaps in the logs. Time: per schedule.
  3. InvestigateRaise a ticket for every unexplained finding, assign it to the system owner, and set a due date by priority. Escalate suspected incidents under the Incident Management Procedure.
  4. ReportSummarise findings, trend and outstanding items in the log review report and send to the Head of IT Security within [3 working days] of the review.
  5. CloseVerify that every ticket has an outcome. Unresolved items older than [30 days] go to the ISMS steering group.
Source groupReview frequencyReviewer
Class 1 authentication and privileged activity[Daily]Security operations
Firewall, VPN and remote access[Weekly]Security operations
Class 2 systems[Weekly summary, monthly in depth]Security operations
Administrator and service account usage[Monthly]Head of IT Security
Physical access logs[Monthly]Facilities and security operations
Class 3 systems[Quarterly sample]IT operations
Log platform health and retention[Monthly]IT operations

11. Responding to Logging Failures

  1. DetectAn alert or review shows a source has stopped sending logs, the platform has run out of space, or time sync has failed.
  2. AssessThe security operations team decides whether the failure could hide an attack; if so, treat as an incident.
  3. RestoreIT operations restores collection and, where possible, recovers buffered logs. Target: Class 1 within [4 hours].
  4. RecordLog the gap in the log source register with start and end times and the cause.
  5. PreventAdd capacity, redundancy or monitoring so the same failure raises an earlier alert.

12. Measures

MeasureTargetHow measured
Class 1 and Class 2 systems registered as log sources[100 percent]Asset register compared with log source register.
Time of log gap for Class 1 sources[Under 4 hours]Log gap entries.
Critical alerts acknowledged within target[95 percent]SIEM or ticketing timestamps.
Scheduled log reviews completed on time[100 percent]Review checklists.
False positive rate for Critical and High rules[Under 30 percent]Closed alerts categorised monthly.
Log review findings closed within due date[90 percent]Ticket report.

13. Records and Evidence

RecordKept inRetention
Log source registerDocument management system[Current plus 3 years of versions]
Log review checklists and reportsTicketing tool[3 years]
Alert tickets and triage notesTicketing tool[3 years]
Rule change records and approvalsTicketing tool[3 years]
Exports of logs used as evidenceEvidence storeUntil the matter closes plus [1 year]

Annexure A: Log source register

Source nameOwnerClassEvents loggedForwarding methodRetentionReviewerLast verified

Annexure B: Log review record

DatePeriod reviewedSourcesReviewerFindingsTickets raisedReport sent

Annexure C: Log access request

FieldEntry
Requester and role
Logs and period requested
Purpose and ticket reference
Individuals whose activity is visible
Approver (security) and data protection officer
Access granted until

14. Exception

Exceptions to this document are allowed only where compliance is not practicable and the risk has been assessed. A request must state what is to be excepted, why, the risk it creates, the compensating controls, and an end date no later than [6 months]. It is approved in writing by the document owner and the risk owner, recorded in the exceptions register, and reviewed at the end date. An exception does not change the document.

15. Enforcement

Compliance is monitored through internal audits, management review and routine checks by the document owner. Non-compliance is reported through the incident or non-conformity process and handled under the organisation's disciplinary procedure, and under the terms of any contract for people who are not employees. Serious or repeated non-compliance may lead to loss of access and, where the law is broken, to referral to the authorities.

16. Review

This document is reviewed at least every [12 months], and when there is a significant change to the organisation, its systems, its risks or the law, or after an incident that shows it was not effective. Each review is recorded in the revision history.

ISO/IEC 27001:2022 references

ReferenceTitle
A.8.15Logging
A.8.16Monitoring activities
A.8.17Clock synchronization
A.5.28Collection of evidence
A.5.24Information security incident management planning and preparation
Sign in to download the PDFFree. You return straight to this document after you sign in.