Analytics dashboard showing data trends

Photo: Stephen Phillips / Unsplash

Guide

How to clean up duplicate data in Salesforce

Where Salesforce duplicates come from, how to measure them, how to merge safely, and the duplicate and matching rules that keep them from coming back.

To clean up duplicate data in Salesforce, measure the problem first, agree on which record wins when two match, merge in batches starting with the highest-value objects, and then turn on duplicate and matching rules so new duplicates are blocked or flagged at entry. Cleanup without prevention only buys a few months.

Where duplicates come from

  • Data imports and migrations that did not check for existing records.
  • Integrations that create a new record instead of updating an existing one.
  • Web forms and marketing tools creating leads for people who are already contacts.
  • Users creating records because searching felt slower than typing.
  • Inconsistent formats: company names with and without suffixes, phone and email variations.

Measure before you merge

Run duplicate reports on accounts, contacts and leads using a few simple keys, such as email address, normalized company name and website domain. Record the duplicate rate for each object so you can show progress and catch regressions later.

Merge safely

A practical merge order
StepWhat to doWhy
1. Decide survivorshipAgree which record wins: most recent activity, most complete, or linked to open opportunitiesPrevents arguments and lost data mid-merge
2. Back upExport affected records and related dataMerges cannot be undone
3. Accounts firstMerge duplicate accounts, then their contactsContacts and opportunities follow the account
4. Leads lastConvert or merge leads that match existing contactsKeeps marketing history attached to the right person
5. Check integrationsConfirm connected systems point at the surviving recordStops the integration from recreating the duplicate

Salesforce’s standard merge tools handle small batches well. For large volumes, a data-quality tool or a scripted merge with a review step is safer than doing thousands of merges by hand.

Stop them coming back

  • Matching rules define what counts as a duplicate for each object.
  • Duplicate rules decide whether to block the save or allow it with an alert.
  • Validation rules and picklists enforce consistent formats for key fields.
  • Integrations should upsert on an external ID rather than insert blindly.
  • A monthly duplicate report keeps the rate visible.

Cleanup is often part of a larger project. A demand-generation firm we worked with restored reliable Salesforce and Pardot sync across 145,000+ prospects, and a medical-device company removed 970+ invalid records to get its prospect count back under its license limit.

How do you calculate a duplicate rate?

Divide the number of records that have at least one likely match by the total active records on that object. Track it per object and per source, so you can see which door the duplicates walk through.

  • Count only active records, or old archived data will distort the number.
  • Tag each record’s source, such as a form, an import, an integration or a user.
  • Report the rate on the same date each month, using the same matching keys.
  • Break it down by owner or team to find habits worth coaching.

Which value wins when two records are merged?

Choosing the surviving record is only half the decision. You also need rules for each important field, because the best value is often on the losing record.

Field-level merge rules
Field typeRule that usually worksExample
Contact detailsMost recently verified valueA phone number confirmed by a rep last month beats an older import
OwnershipOwner of the record with open opportunitiesThe account owner managing a live deal keeps it
Descriptive fieldsMost complete valueA full street address beats a city on its own
Consent and opt-outMost restrictive valueIf either record opted out, the merged record stays opted out
System and external IDsKeep every ID, in separate fields if neededBoth billing IDs are stored so the finance sync still works

How should matching and duplicate rules be tuned?

Start by alerting rather than blocking, then tighten once the matches prove accurate. Rules that block good records teach users to work around them.

  • Run new rules in report-only mode first and review a sample of the matches they flag.
  • Use fuzzy matching on names and exact matching on email and website domain.
  • Set different actions for users and integrations; an integration cannot respond to an alert.
  • Review false positives with the teams who enter data, then adjust the rule.
  • Revisit the rules whenever a new form, import source or integration goes live.

How do integrations avoid creating duplicates?

Every connected system should store a unique key from the other side and update on that key. Salesforce calls this an upsert on an external ID field.

  • Create an external ID field for each source system and mark it unique.
  • Backfill the field on existing records before switching the integration to upsert.
  • Log records the integration could not match, and have a person review them each week.
  • Make sure marketing tools search for existing contacts before creating new leads.
Chris Gooding, President & CEO of Abstrakt Solutions
President & CEO, Abstrakt Solutions
LinkedIn →

Tech Talk

A monthly brief for the people who own Salesforce, AI and revenue technology

What changed in Salesforce and AI this month, and what to do about it.

One email a month. Written by the consultants who deliver the work, not by a marketing team, for the leaders who make the technology decisions.

  • What changed in Salesforce, AI, integration and RevOps, and what it means for your org
  • At least one framework, checklist or reference architecture you can take into a meeting
  • Honest opinions, including when we disagree with what a vendor is selling
  • No sales sequence. We do not sell from this list

Consultant analysis, not vendor recaps. One click to leave.

One email a month. Your industry and your address, nothing else. We never share either, and you can unsubscribe from the bottom of any issue. See what’s in Tech Talk →

Call (314) 916-4095 Book a consultation
Call (314) 916-4095 Book a call