How can you minimize duplicate accounts during an import?<\/p>\n
1. Use the correct import file<\/h2>\n
Your eTapestry database has built-in safeguards to prevent importing the same data file more than once with the same import template, but there are some scenarios where it is possible.<\/p>\n
For example, if you run recurring imports of the same type or are running multiple imports at the same time (say if you split your import file due to the 2,000 row limit), it is possible to accidentally select a data file from a prior import run. If you changed the structure of the prior import file after it was imported, by sorting rows, removing\/adding rows, or formatting columns, the eTapestry import tool may allow you to run the import a second time without recognizing it as the same file.<\/p>\n
While importing a duplicate file is rare, good file management is an essential practice for eTapestry imports.<\/p>\n
Use clear names for each eTapestry import file, including:<\/p>\n
- \n
- Description of the data<\/li>\n
- Date of the export from the source system or the import date<\/li>\n
- File version (like \u201cfinal\u201d) if the data has been altered since export from the source system<\/li>\n
- Sequence of the data if you split an original source file with more than 2,000 rows into multiple smaller files<\/li>\n<\/ul>\n
Before import, you can also check the file name listed under \u201cLast time this specification was used\u201d to confirm that you aren\u2019t choosing a duplicate data file for import.<\/p>\n
![\"eTapestry](\"https:\/\/www.sidekicksolutionsllc.com\/etapestry\/wp-content\/uploads\/sites\/2\/2019\/09\/etapestry-import-specification-last-used.png\")
<\/p>\n2. Remove duplicates from your import file<\/h2>\n
The eTapestry import tool runs a duplicate check on data that already exists in your eTapestry database, but will not identify duplicate rows associated with new accounts within the same import file. A new account is one that isn\u2019t in your eTapestry database yet. Depending on the type of import (account or journal entry), you may need to confirm that your import file doesn\u2019t include multiple rows per new account.<\/p>\n
If you\u2019re importing accounts…<\/em><\/p>\n
Review your spreadsheet carefully for accounts with the same name or contact information. Consolidate or remove duplicate data from your import file. We recommend using Excel\u2019s conditional formatting rules or remove duplicates feature to assist in quick identification and removal of duplicate accounts.<\/p>\n
If you\u2019re importing journal entries\u2026<\/em><\/p>\n
Confirm that each row is a unique journal entry. If your file includes multiple rows (journal entries) for the same account and some accounts are not in eTapestry, import a file of accounts first before importing journal entries<\/strong>. Also confirm that the account data for each journal entry associated with a single account is the same. The potential duplicate check fields of your import like name and contact information must be the same across all rows of the same account for eTapestry to match a duplicate on import.<\/p>\n
3. Select a solid duplicate check (key)<\/h2>\n
The best duplicate check values for import are:<\/p>\n
- \n
- Account Number<\/li>\n
- Account Name and Email<\/li>\n
- Account Name and Address Lines<\/li>\n<\/ul>\n
Account number is a perfect duplicate match if it is available for import. Using account number as your import key offers nearly no chance of creating duplicates in eTapestry.<\/p>\n
![\"eTapestry](\"https:\/\/www.sidekicksolutionsllc.com\/etapestry\/wp-content\/uploads\/sites\/2\/2019\/09\/etapestry-key-on-account-number.png\")
<\/p>\nAccount number isn\u2019t always available as a duplicate check. If account number is not available, choose two other fields for your duplicate match (key). While Account Name and a piece of contact information like Email or Address are great, not every import will use these exact combinations. Select duplicate check fields that offer a complete data set where there is likely to be a unique match, but not too stringent that a potential match might be overlooked because there isn\u2019t enough matching data in eTapestry.<\/p>\n
4. Split your import file and use different duplicate check values<\/h2>\n
The eTapestry import tool allows for only one key or combination of keys as a duplicate check for a single import. This can be a problem if your import file contains incomplete or partial data across the desired duplicate check fields.<\/p>\n
For example, what duplicate check should you use if half of the data in your import file has an email listed and another half has an address listed?<\/p>\n
Selecting email over address or address over email could result in duplicate accounts for the rows of data in your file that are missing a value for the duplicate key field.<\/p>\n
Avoid creating duplicate accounts from incomplete data in your file by splitting your import file into multiple files: one for each duplicate check key or combination of keys.<\/p>\n
Then, import each file with a corresponding import template that uses the Account Name and the duplicate check value (like email or address) you\u2019ve isolated in your file as the keys. Separate imports for each duplicate check increases your chances of matching to existing accounts in your eTapestry database.<\/p>\n
5. Skip unmatched duplicates and re-import with a different duplicate check<\/h2>\n
Another way to reduce duplicates is to run your import and skip the lines in your file that don\u2019t match with existing accounts. After your import is complete, eTapestry will provide you an \u201cExclusion Report\u201d of these skipped lines that you can then manually review, adding more data if needed, and identifying a more appropriate duplicate check for the skipped accounts.<\/p>\n
You can skip lines in your file when you reach Step 4: Possible Duplicates Report, by selecting \u201cSkip Those Lines\u201d in the Import Summary Options for Lines With No matching Account.<\/p>\n
![\"eTapestry](\"https:\/\/www.sidekicksolutionsllc.com\/etapestry\/wp-content\/uploads\/sites\/2\/2019\/09\/etapestry-import-summary-skip-lines.png\")
<\/p>\nThis will exclude all rows where the account didn\u2019t match and provide you an exclusion report after you run the import. Repeat your import with the excluded accounts and pick a different duplicate check value as your key.<\/p>\n
![\"eTapestry](\"https:\/\/www.sidekicksolutionsllc.com\/etapestry\/wp-content\/uploads\/sites\/2\/2019\/09\/etapestry-import-download-skipped-lines.png\")
<\/p>\n6. Review possible duplicates before import<\/h2>\n
When running your import, carefully review duplicate statistics on Step 4: Possible Duplicates Report. When deciding how to handle each potential duplicate, only select “Create New Account” for accounts in your report if you\u2019re certain they are not duplicates and you\u2019ve completed Tip #4 above.<\/p>\n
![\"eTapestry](\"https:\/\/www.sidekicksolutionsllc.com\/etapestry\/wp-content\/uploads\/sites\/2\/2019\/09\/etapestry-import-review-create-account.png\")
<\/p>\nDuplicates are inevitable, so always run the Duplicate Report post import<\/h2>\n
Even with all of the pre-import steps above, your import may still create duplicate accounts. There are no surefire ways to ensure a duplicate-free import (unless you match on Account Number). We recommend running the Duplicate Report after each import.<\/p>\n
Running the Duplicate Report serves as an audit of your import and closes the loop on data quality. Even if you run the Duplicate Report each month, it’s still best practice to run an off-schedule duplicate check immediately following an import. This is especially important if you\u2019re importing a large quantity of data.<\/p>\n
Follow these steps to run the Duplicate Report and merge or ignore duplicates:<\/p>\n
- \n
- Select Reports<\/li>\n
- Select eTapestry Standard Reports<\/li>\n
- Select Duplicate Report from the Account Reports category<\/li>\n
- Select a Category of Base<\/li>\n
- Select a Query of All Constituents – A<\/li>\n
- Select Schedule for Off Hours and schedule the report to run overnight<\/li>\n
- When the report has run, access the report in eTapestry by completing steps 1-3 above and selecting View Existing Report<\/li>\n
- Follow the onscreen instructions to merge or ignore each duplicate pair<\/li>\n<\/ol>\n
![\"eTapestry](\"https:\/\/www.sidekicksolutionsllc.com\/etapestry\/wp-content\/uploads\/sites\/2\/2019\/09\/etapestry-run-duplicate-report.png\")
<\/p>\nMinimizing duplicate accounts during an import is an active process that involves multiple strategies and tactics. With a measured approach to each new import and the application of best practices to your process, you can ensure data health and quality while still benefiting from the efficiency of eTapestry imports.<\/p>\n
Do you run recurring imports from other apps?<\/h3>\n