Corruption detection

From PostgreSQL wiki

(Difference between revisions)
Jump to: navigation, search
(Added link to my article on Pg corruption. It's been posted on the list before too, but figured it might be useful. If you think that's inappropriate feel free to remove.)
 
Line 6: Line 6:
  
 
'''If you think you might be suffering database corruption you're in the wrong place. Read and act on the [[Corruption]] article.'''
 
'''If you think you might be suffering database corruption you're in the wrong place. Read and act on the [[Corruption]] article.'''
 +
 +
An article about steps to avoid and prevent database corruption can be found [http://blog.ringerc.id.au/2012/10/avoiding-postgresql-database-corruption.html here].
  
 
== Types of Corruption ==
 
== Types of Corruption ==

Latest revision as of 12:53, 4 March 2013

If you think you might be suffering database corruption you're in the wrong place. Read and act on the Corruption article.

Contents

[edit] Introduction

Detecting storage layer corruption inside PostgreSQL as early as possible is important. If left undetected, it could not only lead to wrong answers, it can also end up being copied during a base backup (affecting backups and replication). That is a major problem because users will get a false sense of confidence relying on their backup schedule.

If you think you might be suffering database corruption you're in the wrong place. Read and act on the Corruption article.

An article about steps to avoid and prevent database corruption can be found here.

[edit] Types of Corruption

Theoretically, corruption can happen in many areas of hardware, including the memory or even the CPU. However, for this article we focus on corruption happening between the time a page leaves the address space of the backend process until the time it is read back in.

[edit] Minor Challenges

[edit] Utilities and Background Checking

Utilities (such as pg_basebackup) should be updated to verify pages while creating the backup. Also, users might want a continuously-running daemon to slowly validate cold data.

[edit] Detecting Transposed Data

[edit] Zero Pages

[edit] Major Challenges

[edit] Upgrade and On/Off

[edit] Torn Pages

Personal tools