Difference between revisions of "ProDon:Searching and Eliminating Duplicates"

From Logilys
Jump to: navigation, search
 
(16 intermediate revisions by 4 users not shown)
Line 1: Line 1:
=== {{Header_ProDon | | 4.6.5.5 | Nadia Carrier | | 2011/06/28 }}  ===
+
{{Header_TOC}}<br>
 +
 
 +
'''<u>CAUTION</u>''' : This document is for '''VERSION''' '''5''' of '''''Prodon'''''. To go to the document for version 4, [[ProDon:Searching_and_Eliminating_Duplicates (Version 4)|click here]].
 +
 
 +
<br><span style="color: rgb(255, 0, 0);">'''WARNING&nbsp;: This document is currently being edited/revised, it is possible that some parts are missing or obsolete.'''</span>
  
 
== Introduction  ==
 
== Introduction  ==
Line 7: Line 11:
 
<br>  
 
<br>  
  
{| cellspacing="1" cellpadding="1" border="1" style="width: 693px; height: 528px;" class="wikitable"
+
{| width="652" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
| [[Image:Res. and eli. duplicates 001.png]]
+
| [[Image:Res. and eli. duplicates 001.png|716x499px]]
 
|-
 
|-
 
|  
 
|  
Line 18: Line 22:
 
<br>  
 
<br>  
  
{| width="200" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| width="654" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
 
| [[Image:Res. and eli. duplicates 002.png]]
 
| [[Image:Res. and eli. duplicates 002.png]]
Line 31: Line 35:
 
To conduct a duplicates search, you must always go through the Client management.  
 
To conduct a duplicates search, you must always go through the Client management.  
  
<br>
+
<br>  
  
 
== Searching Duplicates  ==
 
== Searching Duplicates  ==
  
To obtain a duplicates list, you need to use the [[ProDon:Customized lists|"Customized lists"]] tool. To do so, click on the "[[Image:Button Personnalised lists.png]]" icon in the Client management and select the "Static list" option.  
+
To obtain a duplicates list, you need to use the [[ProDon:Customized Lists|"Customized lists"]] tool. To do so, click on the "[[Image:Button Personnalised lists.png]]" icon in the Client management and select the "Static list" option.  
  
 
<br>  
 
<br>  
Line 120: Line 124:
 
<br>  
 
<br>  
  
{| cellspacing="1" cellpadding="1" border="1" style="width: 689px; height: 456px;" class="wikitable"
+
{| width="652" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 008.png]]<br>
 
| colspan="2" | [[Image:Res. and eli. duplicates 008.png]]<br>
Line 132: Line 136:
 
|-
 
|-
 
| colspan="2" |  
 
| colspan="2" |  
'''NOTE: '''If the box of the previous step '''<span style="color: rgb(255, 0, 0);">H </span>'''was not checked, you would have to do a filter to obtain the result onscreen. See the [[Common functions:Filter information (queries)|"Filter information"]] document for more details about filters.  
+
'''NOTE: '''If the box of the previous step '''<span style="color: rgb(255, 0, 0);">H </span>'''was not checked, you would have to do a filter to obtain the result onscreen. See the [[Common functions:Filter Data (Queries)|"Filter Data (Queries)"]] document for more details about filters.  
  
 
|}
 
|}
Line 138: Line 142:
 
<br>  
 
<br>  
  
<br>
+
<br>  
  
 
== Remove a Client from the List of Duplicates  ==
 
== Remove a Client from the List of Duplicates  ==
  
{| cellspacing="1" cellpadding="1" border="1" style="width: 683px;" class="wikitable"
+
{| width="656" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
 
| colspan="2" |  
 
| colspan="2" |  
Line 164: Line 168:
 
<br>  
 
<br>  
  
{| cellspacing="1" cellpadding="1" border="1" style="width: 683px;" class="wikitable"
+
{| width="655" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 010.png]]<br>
 
| colspan="2" | [[Image:Res. and eli. duplicates 010.png]]<br>
Line 177: Line 181:
 
<br>  
 
<br>  
  
<br>
+
<br>  
  
 
== Remove a Group of Duplicates from the List  ==
 
== Remove a Group of Duplicates from the List  ==
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| width="656" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
 
| colspan="2" |  
 
| colspan="2" |  
Line 199: Line 203:
 
<br>  
 
<br>  
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| width="651" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 012.png]]<br>
 
| colspan="2" | [[Image:Res. and eli. duplicates 012.png]]<br>
Line 212: Line 216:
 
<br>  
 
<br>  
  
<br>
+
<br>  
  
 
== Merge a Group of Duplicates  ==
 
== Merge a Group of Duplicates  ==
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| width="656" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
 
| colspan="2" |  
 
| colspan="2" |  
Line 236: Line 240:
 
<br>  
 
<br>  
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| cellspacing="1" cellpadding="1" border="1" style="width: 633px; height: 771px;" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 014.png]]<br>
 
| colspan="2" | [[Image:Res. and eli. duplicates 014.png]]<br>
Line 271: Line 275:
 
<br>  
 
<br>  
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| cellspacing="1" cellpadding="1" border="1" style="width: 632px; height: 707px;" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 015.png]]
 
| colspan="2" | [[Image:Res. and eli. duplicates 015.png]]
Line 298: Line 302:
 
<br>  
 
<br>  
  
{| cellspacing="1" cellpadding="1" border="1" class="wikitable" style="width: 400px; height: 180px;"
+
{| cellspacing="1" cellpadding="1" border="1" style="width: 400px; height: 180px;" class="wikitable"
 
|-
 
|-
 
| colspan="2" |  
 
| colspan="2" |  
Line 318: Line 322:
 
After clicking on "[[Image:Button Check mark Confirm.png]] OK" the "Question" window will close automatically. From the merge duplicates window, click again on "[[Image:Button Minus remove delete.png]] Remove from merge", to be able to remove the other clients who are not duplicates.<br>  
 
After clicking on "[[Image:Button Check mark Confirm.png]] OK" the "Question" window will close automatically. From the merge duplicates window, click again on "[[Image:Button Minus remove delete.png]] Remove from merge", to be able to remove the other clients who are not duplicates.<br>  
  
{| cellspacing="1" cellpadding="1" border="1" class="wikitable" style="width: 399px; height: 235px;"
+
{| cellspacing="1" cellpadding="1" border="1" style="width: 399px; height: 235px;" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 017.png]]'''&nbsp;'''
 
| colspan="2" | [[Image:Res. and eli. duplicates 017.png]]'''&nbsp;'''
Line 334: Line 338:
 
<br>  
 
<br>  
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| cellspacing="1" cellpadding="1" border="1" style="width: 633px; height: 633px;" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 018.png]]
 
| colspan="2" | [[Image:Res. and eli. duplicates 018.png]]
Line 391: Line 395:
 
<br>  
 
<br>  
  
<br>
+
<br>  
  
== Details and additional exceptions ==
+
== Details and Additional Exceptions ==
  
 
For the "Gender" field, it is always possible to select either "Male" or "Female". You can also delete the information to to leave the cell empty.  
 
For the "Gender" field, it is always possible to select either "Male" or "Female". You can also delete the information to to leave the cell empty.  
Line 430: Line 434:
 
<br>  
 
<br>  
  
<br>
+
{{Footer_ProDon_Version|4.6.5.5}}<br>
 
 
<br>
 
 
 
<br>
 
 
 
<br>
 
 
 
<br>
 
 
 
<br>
 
 
 
{{Footer_ProDon}}
 

Latest revision as of 10:32, 17 May 2019

Searching and Eliminating Duplicates


CAUTION : This document is for VERSION 5 of Prodon. To go to the document for version 4, click here.


WARNING : This document is currently being edited/revised, it is possible that some parts are missing or obsolete.

Introduction

This procedure allows you to find clients duplicates in an active list. A duplicate occurs when there are more than one file for the same client.


Res. and eli. duplicates 001.png

The active list is the list that is displayed onscreen in the "Client management", the "Task management" or in "Analysis & History".


Res. and eli. duplicates 002.png

If a filter or a search is made, the number of items onscreen decreases, but it still is the active list.


To conduct a duplicates search, you must always go through the Client management.


Searching Duplicates

To obtain a duplicates list, you need to use the "Customized lists" tool. To do so, click on the "Button Personnalised lists.png" icon in the Client management and select the "Static list" option.


Res. and eli. duplicates 003.png

A: Select the option "All potential duplicate clients in the active list".

B: Click on the Button add plus.png button to name the future list of duplicates.



Res. and eli. duplicates 004.png

C: In this window, name the list distinctly.

D: To create a customized list, click on "Button Check mark Confirm.png Confirm addition".



Res. and eli. duplicates 005.png

E: Click on "Edit criteria".



Res. and eli. duplicates 006.png

F: This screen will appear. You then have to choose the duplicates detection criteria.

G: When the criteria are selected, click on "Button Check mark Confirm.png OK".

CAUTION: If the box "Same organization and same department/service" is checked, both must be identical. Therefore, if the companies' names are the same, but the service is different, they will not be detected as potential duplicates.



Res. and eli. duplicates 007.png

H: This box is usually checked by default and allows you to automatically filter the duplicates list after the addition.

I: Click on "Button add plus.png Add to the clients list".



Res. and eli. duplicates 008.png

A: The clients who are potential duplicates are grouped. Alternating colours allow you to differentiate them quickly and easily.

B: Note that three icons will be added at the upper right side of the grid.

NOTE: If the box of the previous step H was not checked, you would have to do a filter to obtain the result onscreen. See the "Filter Data (Queries)" document for more details about filters.



Remove a Client from the List of Duplicates

The button " Button Remove 1 element list.png Remove the client from the list of duplicates" allows you to remove a client from the list.

Res. and eli. duplicates 009.png

A: Get positioned on the client in the group of duplicates you want to remove.

B: Click on Button Remove 1 element list.png.

CAUTION: If there are two clients in a group of duplicates, by clicking on "Remove the client from the list of duplicates", the second client will also be removed automatically.


Res. and eli. duplicates 010.png

There are only two clients left in the group of duplicates out of the initial three.




Remove a Group of Duplicates from the List

The button "Button Remove many elements list.png Remove the group from the list of duplicates" allows you to remove an entire group from the list of duplicates.

Res. and eli. duplicates 011.png

A: Get positioned on one of the clients you want to remove from the group of duplicates.

B: Click on Button Remove many elements list.png.


Res. and eli. duplicates 012.png

The group disappears and the alternating colours adjust accordingly in order to better differentiate the groups of duplicates.




Merge a Group of Duplicates

The button "Button Merge.png Merge the duplicates" allows you to access the merge duplicates interface.

Res. and eli. duplicates 013.png

A: Select a client in the group of duplicates to merge.

B: Click on Button Merge.png.



Res. and eli. duplicates 014.png

A: This column contains the names of the processed fields for each line.

B: This column contains the information of the first client to be merged.

C: This column contains the information of the second client to be merged.

D and E: These two columns contain the information of the other clients to be merged. A maximum of 10 clients can be processed at the same time. If the group contains more than 10 clients, the client resulting from the merge will be placed in the group of duplicates with the remaining clients.

F: This column contains the desired result of the merge.

NOTE: By default, the first available information in client order is entered in column F "Result". For example, if column B "Client 1" is empty and columns C "Client 2" and D "Client 3" contain information, column F "Result" will contain the information of column C "Client 2".

EXCEPTIONS: For the information corresponding to a check box, the answer "Yes" is always selected if it is available for one of the clients to merge.



Res. and eli. duplicates 015.png

A: In this example, the two first clients are duplicates.

B: This client is not a duplicate, so you should remove him from the list.

C: This client is not a duplicate either, so you should also remove him from the list.

D: To remove clients 3 and 4 from the list of duplicates to merge, click on "Button Minus remove delete.png Remove from merge".

NOTE: This option is not available if there are only two clients to merge.



This window opens.

Res. and eli. duplicates 016.png

E: Using the drop-down list, select the client to be removed from the list of duplicates to merge.

B: Click on "Button Check mark Confirm.png OK".


After clicking on "Button Check mark Confirm.png OK" the "Question" window will close automatically. From the merge duplicates window, click again on "Button Minus remove delete.png Remove from merge", to be able to remove the other clients who are not duplicates.

Res. and eli. duplicates 017.png 

G: Using the drop-down list, select the client to be removed from the list of duplicates to merge.

H: Click on "Button Check mark Confirm.png OK".



Res. and eli. duplicates 018.png

I: The "Result" column has been refreshed and the information is put back in client order, if it came from the removed client. The "Result" column contains all the information of the "Client 1" column.

J: Note that the "Button Minus remove delete.png Remove from merge" button is no longer there since there are only two clients in the merge.



Res. and eli. duplicates 019.png

K: It is also possible to assign the information corresponding to a particular client column to the "Result" column. To do so, you need to click on the header of the column. In this example, the "Result" column now contains all the information of "Client 2".



Res. and eli. duplicates 020.png

L: The only fields that remain untouched by this function are the fields highlighted in blue at the bottom of the merge grid. For these fields, the merge is compulsory and there is no other option.



Res. and eli. duplicates 021.png

M: It is also possible to choose manually the wanted result for each orange line. To do so, you need to click on the white cell to be edited in the "Result" column. A button of the drop-down list then appears and displays the possible choices.

NOTE: You can also type the desired information in each of the fields where it is possible to enter information in the client file.



Details and Additional Exceptions

For the "Gender" field, it is always possible to select either "Male" or "Female". You can also delete the information to to leave the cell empty.

For the "Language" field, it is always possible to choose from all the languages available in ProDon.

For the fields corresponding to a check box, it is possible to select "Yes" or "No" only if the answers are available for one of the clients present in the merge interface. For example, if all the clients have "No" at the "No receipt wanted" field, it will be impossible to select "Yes".

For the fields: "Sector, Canvasser, Designated gift, of date type, customized fields of predefined or numerical list type", you must choose from the available choices in accordance with the clients present in the merge interface. For example, if none of the clients has a sector of activity, it will be impossible to choose one.

For the "Categories" field, you must select the information corresponding to a particular client or merge the information of all the clients.

Many verifications are done when merging, some will require your intervention and others will apply automatically. For instance, it is impossible to merge a client for whom you have selected "No" at the "Deceased" field and for whom you would have entered a date of death.


Res. and eli. duplicates 022.png

It is possible to double-click in the "Adress", "Comment" and "Message" fields in order to see the complete information even if it contains several lines.



The green lines contain an identical piece of information for each client.

The orange lines contain different information for at least two clients.

The blue lines contain information that will inevitably be merged.



Document name: ProDon:Searching and Eliminating Duplicates
Version : 4.6.5.5