Reducing duplicate records in your CRM

Duplicate records creep into most nonprofit databases. A donor gives online with a new email address, a volunteer signs up at an event, a list is imported from a spreadsheet — and suddenly one person has three records, each with part of their history.

Duplicates cause real problems: split giving histories, two copies of the same appeal, receipts with the wrong totals, and reports that overstate how many supporters you have. Here's a practical way to reduce them.

Why duplicates happen

• Several ways into the database, such as forms, donation platforms, imports and manual entry
• Name variations (Bill and William, or a changed surname)
• New email addresses or phone numbers
• Households and couples entered in different ways
• Imports without a matching step

1. Measure before you merge

Run a duplicate report to see how big the problem is and where it comes from. Group suspected duplicates by source — for example, online forms or a particular import — so you can fix the cause as well as the symptoms.

2. Agree your matching rules

Decide what counts as a likely duplicate. Common rules include the same email address; the same first name, last name and postal code; or the same phone number and last name. Start with strict rules, then widen them carefully once you trust the results.

3. Merge carefully

• Back up your data before a large merge.
• Decide which record survives and which fields win (for example, the most recently updated address).
• Keep giving history, soft credits, relationships and communication preferences.
• Respect opt-outs: if either record has opted out of a channel, keep the opt-out.
• Work in batches and review a sample of each batch.

If you use Salesforce, matching rules and duplicate rules help identify duplicates, and the Nonprofit Success Pack (NPSP) includes tools for merging contacts while keeping their related records.

4. Prevent new duplicates

• Turn on duplicate checks where records are created, including form and donation integrations.
• Match incoming online gifts to existing supporters before creating a new record.
• Use a short import checklist: standard formats, a matching step and a test with a small file first.
• Give staff a quick way to search before they create a record.

5. Keep it clean

Schedule a monthly duplicate review, track the share of records that are duplicates over time, and note which source creates the most. A small, regular routine takes far less effort than a large clean-up each year.

This article is general information, not legal, tax or financial advice.