Difference between revisions of "ProDon:Searching and Eliminating Duplicates"

From Logilys
Jump to: navigation, search
 
(48 intermediate revisions by 4 users not shown)
Line 1: Line 1:
=== {{Header_ProDon | | 4.6.5.5 | Nadia Carrier | | 2011/06/28 }}  ===
+
{{Header_TOC}}<br>
 +
 
 +
'''<u>CAUTION</u>''' : This document is for '''VERSION''' '''5''' of '''''Prodon'''''. To go to the document for version 4, [[ProDon:Searching_and_Eliminating_Duplicates (Version 4)|click here]].
 +
 
 +
<br><span style="color: rgb(255, 0, 0);">'''WARNING&nbsp;: This document is currently being edited/revised, it is possible that some parts are missing or obsolete.'''</span>
  
 
== Introduction  ==
 
== Introduction  ==
Line 7: Line 11:
 
<br>  
 
<br>  
  
{| cellspacing="1" cellpadding="1" border="1" class="wikitable" style="width: 693px; height: 528px;"
+
{| width="652" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
| [[Image:Res. and eli. duplicates 001.png]]
+
| [[Image:Res. and eli. duplicates 001.png|716x499px]]
 
|-
 
|-
| The active list is the list that is displayed onscreen in the "Client management", the "Task management" or in "Analysis &amp; History".
+
|  
 +
The active list is the list that is displayed onscreen in the "Client management", the "Task management" or in "Analysis &amp; History".  
 +
 
 
|}
 
|}
  
 
<br>  
 
<br>  
  
{| width="200" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| width="654" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
 
| [[Image:Res. and eli. duplicates 002.png]]
 
| [[Image:Res. and eli. duplicates 002.png]]
 
|-
 
|-
| If a filter or a search is made, the number of items onscreen decreases, but it still ris the active list.
+
|  
 +
If a filter or a search is made, the number of items onscreen decreases, but it still is the active list.  
 +
 
 
|}
 
|}
  
Line 27: Line 35:
 
To conduct a duplicates search, you must always go through the Client management.  
 
To conduct a duplicates search, you must always go through the Client management.  
  
<br>
+
<br>  
  
== Searching duplicates ==
+
== Searching Duplicates ==
  
To obtain a duplicates list, you need to use the Customized lists tool. To do so, click on the "[[Image:Button Personnalised lists.png]]" icon in the Client management and select the "Static list" option.  
+
To obtain a duplicates list, you need to use the [[ProDon:Customized Lists|"Customized lists"]] tool. To do so, click on the "[[Image:Button Personnalised lists.png]]" icon in the Client management and select the "Static list" option.  
  
 
<br>  
 
<br>  
Line 39: Line 47:
 
| colspan="2" | [[Image:Res. and eli. duplicates 003.png]]
 
| colspan="2" | [[Image:Res. and eli. duplicates 003.png]]
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">A: </span>'''Select the option "All potential duplicate clients in the active list".  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on the [[Image:Button add plus.png]] button to name the future list of duplicates.
+
'''<span style="color: rgb(255, 0, 0);">A: </span>'''Select the option "All potential duplicate clients in the active list".  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on the [[Image:Button add plus.png]] button to name the future list of duplicates.  
 +
 
 
|}
 
|}
  
Line 51: Line 63:
 
| colspan="2" | [[Image:Res. and eli. duplicates 004.png]]
 
| colspan="2" | [[Image:Res. and eli. duplicates 004.png]]
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">C: </span>'''In this window, name the list distinctly.  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">D: </span>'''To create a customized list, click on "[[Image:Button Check mark Confirm.png]] Confirm addition".
+
'''<span style="color: rgb(255, 0, 0);">C: </span>'''In this window, name the list distinctly.  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">D: </span>'''To create a customized list, click on "[[Image:Button Check mark Confirm.png]] Confirm addition".  
 +
 
 
|}
 
|}
  
Line 63: Line 79:
 
| [[Image:Res. and eli. duplicates 005.png]]
 
| [[Image:Res. and eli. duplicates 005.png]]
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">E: </span>'''Click on "Edit criteria".
+
|  
 +
'''<span style="color: rgb(255, 0, 0);">E: </span>'''Click on "Edit criteria".  
 +
 
 
|}
 
|}
  
Line 74: Line 92:
 
| colspan="2" | [[Image:Res. and eli. duplicates 006.png]]
 
| colspan="2" | [[Image:Res. and eli. duplicates 006.png]]
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">F: </span>'''This screen will appear. You then have to choose the duplicates detection criteria.  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">G: </span>'''When the criteria are selected, click on "[[Image:Button Check mark Confirm.png]] OK".
+
'''<span style="color: rgb(255, 0, 0);">F: </span>'''This screen will appear. You then have to choose the duplicates detection criteria.  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">G: </span>'''When the criteria are selected, click on "[[Image:Button Check mark Confirm.png]] OK".  
 +
 
 
|-
 
|-
| colspan="2" | '''WARNING: '''If the box "Same organization and same department/service" is checked, both must be identical. Therefore, if the company's names are the same, but the service is different, they will not be detected as potential duplicates.
+
| colspan="2" |  
 +
'''CAUTION: '''If the box "Same organization and same department/service" is checked, both must be identical. Therefore, if the companies' names are the same, but the service is different, they will not be detected as potential duplicates.  
 +
 
 
|}
 
|}
  
Line 88: Line 112:
 
| colspan="2" | [[Image:Res. and eli. duplicates 007.png]]<br>
 
| colspan="2" | [[Image:Res. and eli. duplicates 007.png]]<br>
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">H: </span>'''This box is usually checked by default and allows you to automatically filter the duplicates list after the addition.<br>
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">I: </span>'''Click on "[[Image:Button add plus.png]] Add to the client list".<br>
+
'''<span style="color: rgb(255, 0, 0);">H: </span>'''This box is usually checked by default and allows you to automatically filter the duplicates list after the addition.  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">I: </span>'''Click on "[[Image:Button add plus.png]] Add to the clients list".  
 +
 
 
|}
 
|}
  
Line 96: Line 124:
 
<br>  
 
<br>  
  
{| cellspacing="1" cellpadding="1" border="1" style="width: 689px; height: 456px;" class="wikitable"
+
{| width="652" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
| colspan="2" | [[Image:Res._and_eli._duplicates_008.png]]<br>
+
| colspan="2" | [[Image:Res. and eli. duplicates 008.png]]<br>
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">A: </span>'''The clients who are potential duplicates are grouped. Alternating colours allow you to differentiate them quickly and easily. <br>
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">B: </span>'''Note that three icons will be added at the upper right side of the grid.<br>
+
'''<span style="color: rgb(255, 0, 0);">A: </span>'''The clients who are potential duplicates are grouped. Alternating colours allow you to differentiate them quickly and easily.  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">B: </span>'''Note that three icons will be added at the upper right side of the grid.  
 +
 
 
|-
 
|-
| colspan="2" | '''NOTE: '''If the <span style="color: rgb(255, 0, 0);">'''H'''</span> box of the previous step is not checked, you will have to create a filter to obtain this result onscreen. See the Filter information document for more details about filters.<br>
+
| colspan="2" |  
 +
'''NOTE: '''If the box of the previous step '''<span style="color: rgb(255, 0, 0);">H </span>'''was not checked, you would have to do a filter to obtain the result onscreen. See the [[Common functions:Filter Data (Queries)|"Filter Data (Queries)"]] document for more details about filters.  
 +
 
 
|}
 
|}
  
 
<br>  
 
<br>  
  
<br>
+
<br>  
  
== Remove a client from the duplicates list ==
+
== Remove a Client from the List of Duplicates ==
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| width="656" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
| colspan="2" | The button " [[Image:Button Remove 1 element list.png]] Remove the client from the list of duplicates" allows you to remove a client from the list.
+
| colspan="2" |  
 +
The button " [[Image:Button Remove 1 element list.png]] Remove the client from the list of duplicates" allows you to remove a client from the list.  
 +
 
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 009.png]]<br>
 
| colspan="2" | [[Image:Res. and eli. duplicates 009.png]]<br>
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">A: </span>'''Get positioned on the client you want to remove from the list of potential duplicates.  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on [[Image:Button Remove 1 element list.png]].
+
'''<span style="color: rgb(255, 0, 0);">A: </span>'''Get positioned on the client in the group of duplicates you want to remove.  
 +
 
 +
| width="50%" |
 +
'''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on [[Image:Button Remove 1 element list.png]].  
 +
 
 
|-
 
|-
| colspan="2" | '''WARNING:''' If there are two clients in a group of duplicates, by clicking on "Remove the client from the list of duplicates", the second client will also be removed automatically.
+
| colspan="2" |  
 +
'''CAUTION:''' If there are two clients in a group of duplicates, by clicking on "Remove the client from the list of duplicates", the second client will also be removed automatically.  
 +
 
 +
|}
 +
 
 +
<br>
 +
 
 +
{| width="655" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
| colspan="2" | [[Image:Res._and_eli._duplicates_010.png]]<br>
+
| colspan="2" | [[Image:Res. and eli. duplicates 010.png]]<br>
 
|-
 
|-
| colspan="2" | There are only two clients left in the group of duplicates out of the initial three.
+
| colspan="2" |  
 +
There are only two clients left in the group of duplicates out of the initial three.  
 +
 
 
|}
 
|}
  
Line 132: Line 181:
 
<br>  
 
<br>  
  
<br>
+
<br>  
  
== Remove a group of duplicates from the list ==
+
== Remove a Group of Duplicates from the List ==
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| width="656" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
| colspan="2" | The button "[[Image:Button Remove many elements list.png]] Remove the group from the list of duplicates" allows you to remove an entire group from the list of duplicates.
+
| colspan="2" |  
 +
The button "[[Image:Button Remove many elements list.png]] Remove the group from the list of duplicates" allows you to remove an entire group from the list of duplicates.  
 +
 
 
|-
 
|-
| colspan="2" | [[Image:Res._and_eli._duplicates_011.png]]<br>
+
| colspan="2" | [[Image:Res. and eli. duplicates 011.png]]<br>
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">A: </span>'''Get positioned on one of the clients you want to remove from the group of duplicates.  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on [[Image:Button Remove many elements list.png]].
+
'''<span style="color: rgb(255, 0, 0);">A: </span>'''Get positioned on one of the clients you want to remove from the group of duplicates.  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on [[Image:Button Remove many elements list.png]].  
 +
 
 +
|}
 +
 
 +
<br>
 +
 
 +
{| width="651" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
| colspan="2" | [[Image:Res._and_eli._duplicates_012.png]]<br>
+
| colspan="2" | [[Image:Res. and eli. duplicates 012.png]]<br>
 
|-
 
|-
| colspan="2" | The group disappears and the alternating colours adjust accordingly in order to better differentiate the groups of duplicates.
+
| colspan="2" |  
 +
The group disappears and the alternating colours adjust accordingly in order to better differentiate the groups of duplicates.  
 +
 
 
|}
 
|}
  
Line 154: Line 216:
 
<br>  
 
<br>  
  
<br>
+
<br>  
  
== Merge a group of duplicates ==
+
== Merge a Group of Duplicates ==
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| width="656" cellspacing="1" cellpadding="1" border="1" class="wikitable"
 
|-
 
|-
| colspan="2" | The button "[[Image:Button Merge.png]] Merge the duplicates" allows you to access the duplcates merging interface.
+
| colspan="2" |  
 +
The button "[[Image:Button Merge.png]] Merge the duplicates" allows you to access the merge duplicates interface.  
 +
 
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 013.png]]<br>
 
| colspan="2" | [[Image:Res. and eli. duplicates 013.png]]<br>
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">A: </span>'''Select a client in the group of duplicates to merge.  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on [[Image:Button Merge.png]].
+
'''<span style="color: rgb(255, 0, 0);">A: </span>'''Select a client in the group of duplicates to merge.  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on [[Image:Button Merge.png]].  
 +
 
 
|}
 
|}
  
Line 172: Line 240:
 
<br>  
 
<br>  
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| cellspacing="1" cellpadding="1" border="1" style="width: 633px; height: 771px;" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 014.png]]<br>
 
| colspan="2" | [[Image:Res. and eli. duplicates 014.png]]<br>
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">A; </span>'''This column contains the names of the processed fields for each line.  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">B: </span>'''This column contains the information of the first client to be merged.
+
'''<span style="color: rgb(255, 0, 0);">A: </span>'''This column contains the names of the processed fields for each line.  
 +
 
 +
| width="50%" |
 +
'''<span style="color: rgb(255, 0, 0);">B: </span>'''This column contains the information of the first client to be merged.  
 +
 
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">C: </span>'''This column contains the information of the second client to be merged.  
+
| width="50%" |
| <span style="color: rgb(255, 0, 0);">'''D and E:''' </span>These two columns contain the information of the other clients to be merged. A maximum of 10 clients can be processed at the same time. If the group contains more than 10 clients, the client resulting from the merge will be placed in the group of duplicates with the remianing clients.
+
'''<span style="color: rgb(255, 0, 0);">C: </span>'''This column contains the information of the second client to be merged.  
 +
 
 +
| width="50%" |  
 +
<span style="color: rgb(255, 0, 0);">'''D'''<span style="color: rgb(0, 0, 0);">''' '''and </span>'''E:''' </span>These two columns contain the information of the other clients to be merged. A maximum of 10 clients can be processed at the same time. If the group contains more than 10 clients, the client resulting from the merge will be placed in the group of duplicates with the remaining clients.  
 +
 
 
|-
 
|-
| colspan="2" | '''<span style="color: rgb(255, 0, 0);">F: </span>'''This column contains the desired result of the merge.
+
| colspan="2" |  
 +
'''<span style="color: rgb(255, 0, 0);">F: </span>'''This column contains the desired result of the merge.  
 +
 
 
|-
 
|-
| colspan="2" | '''NOTE: '''By default, the first available information in client order is entered in column <span style="color: rgb(255, 0, 0);">'''F'''</span> "Result". For example, if column <span style="color: rgb(255, 0, 0);">'''B'''</span> "Client 1" is empty and that columns <span style="color: rgb(255, 0, 0);">'''C'''</span> "Client 2" and <span style="color: rgb(255, 0, 0);">'''D''' </span>"Client 3" contain information, column <span style="color: rgb(255, 0, 0);">'''B'''</span> "Result" will contain the information of column <span style="color: rgb(255, 0, 0);">'''C'''</span> "Client 2".
+
| colspan="2" |  
 +
'''NOTE: '''By default, the first available information in client order is entered in column <span style="color: rgb(255, 0, 0);">'''F'''</span> "Result". For example, if column <span style="color: rgb(255, 0, 0);">'''B'''</span> "Client 1" is empty and columns <span style="color: rgb(255, 0, 0);">'''C'''</span> "Client 2" and <span style="color: rgb(255, 0, 0);">'''D''' </span>"Client 3" contain information, column <span style="color: rgb(255, 0, 0);">'''F'''</span> "Result" will contain the information of column <span style="color: rgb(255, 0, 0);">'''C'''</span> "Client 2".  
 +
 
 
|-
 
|-
| colspan="2" | '''EXCEPTIONS: '''For the information corresponding to a check box, the answer "Yes" is always selected if it appears for one of the clients to merge.
+
| colspan="2" |  
 +
'''EXCEPTIONS: '''For the information corresponding to a check box, the answer "Yes" is always selected if it is available for one of the clients to merge.  
 +
 
 
|}
 
|}
  
Line 193: Line 275:
 
<br>  
 
<br>  
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| cellspacing="1" cellpadding="1" border="1" style="width: 632px; height: 707px;" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 015.png]]
 
| colspan="2" | [[Image:Res. and eli. duplicates 015.png]]
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">A: </span>'''In this example, the two first clients are duplicates.  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">B:</span>'''<span style="color: rgb(255, 0, 0);"> <span style="color: rgb(0, 0, 0);">This client is not a duplicate, so you should remove him from the list.</span></span>
+
'''<span style="color: rgb(255, 0, 0);">A: </span>'''In this example, the two first clients are duplicates.  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">B:</span>'''<span style="color: rgb(255, 0, 0);"> <span style="color: rgb(0, 0, 0);">This client is not a duplicate, so you should remove him from the list.</span></span>  
 +
 
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">C: </span>'''<span style="color: rgb(255, 0, 0);"><span style="color: rgb(0, 0, 0);">This client is not a duplicate either, so you should also remove him from the list.</span></span>  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">D: </span>'''To remove clients 3 and 4 from the list of duplicates to merge, click on "[[Image:Button Minus remove delete.png]] Remove from merge".
+
'''<span style="color: rgb(255, 0, 0);">C: </span>'''<span style="color: rgb(255, 0, 0);"><span style="color: rgb(0, 0, 0);">This client is not a duplicate either, so you should also remove him from the list.</span></span>  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">D: </span>'''To remove clients 3 and 4 from the list of duplicates to merge, click on "[[Image:Button Minus remove delete.png]] Remove from merge".  
 +
 
 
|-
 
|-
| colspan="2" | '''NOTE:''' This option is not available if there are only two clients to merge.
+
| colspan="2" |  
 +
'''NOTE:''' This option is not available if there are only two clients to merge.  
 +
 
 
|}
 
|}
  
Line 212: Line 304:
 
{| cellspacing="1" cellpadding="1" border="1" style="width: 400px; height: 180px;" class="wikitable"
 
{| cellspacing="1" cellpadding="1" border="1" style="width: 400px; height: 180px;" class="wikitable"
 
|-
 
|-
| colspan="2" | This window opens.
+
| colspan="2" |  
 +
This window opens.  
 +
 
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 016.png]]<br>
 
| colspan="2" | [[Image:Res. and eli. duplicates 016.png]]<br>
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">E: </span>'''Using the drop-down list, select the client to be removed from the list of duplicates to merge.<br>
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on "[[Image:Button Check mark Confirm.png]] OK".
+
'''<span style="color: rgb(255, 0, 0);">E: </span>'''Using the drop-down list, select the client to be removed from the list of duplicates to merge.  
 +
 
 +
| width="50%" |
 +
'''<span style="color: rgb(255, 0, 0);">B: </span>'''Click on "[[Image:Button Check mark Confirm.png]] OK".  
 +
 
 
|}
 
|}
  
Line 224: Line 322:
 
After clicking on "[[Image:Button Check mark Confirm.png]] OK" the "Question" window will close automatically. From the merge duplicates window, click again on "[[Image:Button Minus remove delete.png]] Remove from merge", to be able to remove the other clients who are not duplicates.<br>  
 
After clicking on "[[Image:Button Check mark Confirm.png]] OK" the "Question" window will close automatically. From the merge duplicates window, click again on "[[Image:Button Minus remove delete.png]] Remove from merge", to be able to remove the other clients who are not duplicates.<br>  
  
<br>  
+
{| cellspacing="1" cellpadding="1" border="1" style="width: 399px; height: 235px;" class="wikitable"
 +
|-
 +
| colspan="2" | [[Image:Res. and eli. duplicates 017.png]]'''&nbsp;'''
 +
|-
 +
| width="50%" |
 +
'''<span style="color: rgb(255, 0, 0);">G: </span>'''Using the drop-down list, select the client to be removed from the list of duplicates to merge.
  
<br>  
+
| width="50%" |
 +
'''<span style="color: rgb(255, 0, 0);">H: </span>'''Click on "[[Image:Button Check mark Confirm.png]] OK".
  
{| cellspacing="1" cellpadding="1" border="1" style="width: 399px; height: 159px;" class="wikitable"
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 017.png]]'''&lt;span style="color: rgb(255, 0, 0);" /&gt;'''
 
|-
 
| '''<span style="color: rgb(255, 0, 0);">G: </span>'''Using the drop-down list, select the client to remove from the list of duplicates to merge.
 
| '''<span style="color: rgb(255, 0, 0);">H: </span>'''Click on "[[Image:Button Check mark Confirm.png]] OK".
 
 
|}
 
|}
  
Line 240: Line 338:
 
<br>  
 
<br>  
  
{| width="50%" cellspacing="1" cellpadding="1" border="1" class="wikitable"
+
{| cellspacing="1" cellpadding="1" border="1" style="width: 633px; height: 633px;" class="wikitable"
 
|-
 
|-
 
| colspan="2" | [[Image:Res. and eli. duplicates 018.png]]
 
| colspan="2" | [[Image:Res. and eli. duplicates 018.png]]
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">I: </span>'''The "Result" column was refreshed and the information is put back in client order, if it came from the removed client. The "Result" column contains all the information of the "Client 1" column.  
+
| width="50%" |
| '''<span style="color: rgb(255, 0, 0);">J: </span>'''Note that the "[[Image:Button Minus remove delete.png]] Remove from merge" button is no longer there since there are only two clients in the merge.
+
'''<span style="color: rgb(255, 0, 0);">I: </span>'''The "Result" column has been refreshed and the information is put back in client order, if it came from the removed client. The "Result" column contains all the information of the "Client 1" column.  
 +
 
 +
| width="50%" |  
 +
'''<span style="color: rgb(255, 0, 0);">J: </span>'''Note that the "[[Image:Button Minus remove delete.png]] Remove from merge" button is no longer there since there are only two clients in the merge.  
 +
 
 
|}
 
|}
  
Line 256: Line 358:
 
| [[Image:Res. and eli. duplicates 019.png]]
 
| [[Image:Res. and eli. duplicates 019.png]]
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">K: </span>'''It is also possible to assign the information corresponding to a particular client column to the "Result" column. To do so, you need to click on the header of the column. In this example, the "Result" column now contains all the information of "Client 2".
+
|  
 +
'''<span style="color: rgb(255, 0, 0);">K: </span>'''It is also possible to assign the information corresponding to a particular client column to the "Result" column. To do so, you need to click on the header of the column. In this example, the "Result" column now contains all the information of "Client 2".  
 +
 
 
|}
 
|}
  
Line 267: Line 371:
 
| [[Image:Res. and eli. duplicates 020.png]]
 
| [[Image:Res. and eli. duplicates 020.png]]
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">L: </span>'''The only fields that remain untouched by this function are the fields highlighted in blue at the bottom of the merge grid. For these fields, the merge is compulsory and there is no other option.
+
|  
 +
'''<span style="color: rgb(255, 0, 0);">L: </span>'''The only fields that remain untouched by this function are the fields highlighted in blue at the bottom of the merge grid. For these fields, the merge is compulsory and there is no other option.  
 +
 
 
|}
 
|}
  
Line 278: Line 384:
 
| [[Image:Res. and eli. duplicates 021.png]]
 
| [[Image:Res. and eli. duplicates 021.png]]
 
|-
 
|-
| '''<span style="color: rgb(255, 0, 0);">M: </span>'''It is also possible to choose manually the wanted result for each orange line. To do so, you need to click on the white cell to be edited in the "Result" column. A button of the drop-down list then appears and displays the possible choices.
+
|  
 +
'''<span style="color: rgb(255, 0, 0);">M: </span>'''It is also possible to choose manually the wanted result for each orange line. To do so, you need to click on the white cell to be edited in the "Result" column. A button of the drop-down list then appears and displays the possible choices.  
 +
 
 
|-
 
|-
| '''NOTE: '''You can also type the desired information in each of the fields where it is possible to enter information in the client file.
+
|  
 +
'''NOTE: '''You can also type the desired information in each of the fields where it is possible to enter information in the client file.  
 +
 
 
|}
 
|}
  
 
<br>  
 
<br>  
  
<br>
+
<br>  
  
== Details and additional exceptions ==
+
== Details and Additional Exceptions ==
  
For the "Gender" field, it is always possible to select either "Male or Female". You can also delete the informationto leave the cell empty.  
+
For the "Gender" field, it is always possible to select either "Male" or "Female". You can also delete the information to to leave the cell empty.  
  
For the "Language" field, it is always possible to choose from all the available languages in '''''ProDon'''''.  
+
For the "Language" field, it is always possible to choose from all the languages available in '''''ProDon'''''.  
  
For the fields corresponding to a check box, it is possible to select "Yes" or "No" only if the answers are available for one of the clients present in the merge interface. For example, if all the clients have the "No receipt wanted" field to "No", it will be impossible to select "Yes".  
+
For the fields corresponding to a check box, it is possible to select "Yes" or "No" only if the answers are available for one of the clients present in the merge interface. For example, if all the clients have "No" at the "No receipt wanted" field, it will be impossible to select "Yes".  
  
For the fields: "Sector, Canvasser, Designated gift, of date type, Customized fields of predefined or numerical list type", you must choose from the available choices in accordance with the clients present in the merge interface. For example, if none of the clients has a line of business, it will be impossible to choose one.  
+
For the fields: "Sector, Canvasser, Designated gift, of date type, customized fields of predefined or numerical list type", you must choose from the available choices in accordance with the clients present in the merge interface. For example, if none of the clients has a sector of activity, it will be impossible to choose one.  
  
For the "Categories" field, you must select the information corresponding to a particular client or merge the information from all the clients.  
+
For the "Categories" field, you must select the information corresponding to a particular client or merge the information of all the clients.  
  
Many verifications are done when merging, some will require your intervention and others will apply automatically. For instance, it is impossible to merge a client for whom you have selected "No" at the "Deceased" field and for whom you would have entered a death date.<br>  
+
Many verifications are done when merging, some will require your intervention and others will apply automatically. For instance, it is impossible to merge a client for whom you have selected "No" at the "Deceased" field and for whom you would have entered a date of death.<br>  
  
 
<br>  
 
<br>  
Line 307: Line 417:
 
| [[Image:Res. and eli. duplicates 022.png]]
 
| [[Image:Res. and eli. duplicates 022.png]]
 
|-
 
|-
| It is possible to double-click in the "Adress", "Comment" and "Message" fields in order to see the complete information even if&nbsp; it contains several lines.
+
|  
 +
It is possible to double-click in the "Adress", "Comment" and "Message" fields in order to see the complete information even if it contains several lines.  
 +
 
 
|}
 
|}
 
<br>
 
 
 
 
The green lines contain an identical piece of information for each client.
 
 
The orange lines contain different information for at least two clients.
 
 
The blue lines contain information that will inevitably be merged.
 
  
 
<br>  
 
<br>  
Line 324: Line 426:
 
<br>  
 
<br>  
  
<br>
+
The green lines contain an identical piece of information for each client.
  
<br>
+
The orange lines contain different information for at least two clients.
  
<br>
+
The blue lines contain information that will inevitably be merged.
 
 
<br>
 
  
 
<br>  
 
<br>  
  
{{Footer_ProDon}}
+
{{Footer_ProDon_Version|4.6.5.5}}<br>

Latest revision as of 10:32, 17 May 2019

Searching and Eliminating Duplicates


CAUTION : This document is for VERSION 5 of Prodon. To go to the document for version 4, click here.


WARNING : This document is currently being edited/revised, it is possible that some parts are missing or obsolete.

Introduction

This procedure allows you to find clients duplicates in an active list. A duplicate occurs when there are more than one file for the same client.


Res. and eli. duplicates 001.png

The active list is the list that is displayed onscreen in the "Client management", the "Task management" or in "Analysis & History".


Res. and eli. duplicates 002.png

If a filter or a search is made, the number of items onscreen decreases, but it still is the active list.


To conduct a duplicates search, you must always go through the Client management.


Searching Duplicates

To obtain a duplicates list, you need to use the "Customized lists" tool. To do so, click on the "Button Personnalised lists.png" icon in the Client management and select the "Static list" option.


Res. and eli. duplicates 003.png

A: Select the option "All potential duplicate clients in the active list".

B: Click on the Button add plus.png button to name the future list of duplicates.



Res. and eli. duplicates 004.png

C: In this window, name the list distinctly.

D: To create a customized list, click on "Button Check mark Confirm.png Confirm addition".



Res. and eli. duplicates 005.png

E: Click on "Edit criteria".



Res. and eli. duplicates 006.png

F: This screen will appear. You then have to choose the duplicates detection criteria.

G: When the criteria are selected, click on "Button Check mark Confirm.png OK".

CAUTION: If the box "Same organization and same department/service" is checked, both must be identical. Therefore, if the companies' names are the same, but the service is different, they will not be detected as potential duplicates.



Res. and eli. duplicates 007.png

H: This box is usually checked by default and allows you to automatically filter the duplicates list after the addition.

I: Click on "Button add plus.png Add to the clients list".



Res. and eli. duplicates 008.png

A: The clients who are potential duplicates are grouped. Alternating colours allow you to differentiate them quickly and easily.

B: Note that three icons will be added at the upper right side of the grid.

NOTE: If the box of the previous step H was not checked, you would have to do a filter to obtain the result onscreen. See the "Filter Data (Queries)" document for more details about filters.



Remove a Client from the List of Duplicates

The button " Button Remove 1 element list.png Remove the client from the list of duplicates" allows you to remove a client from the list.

Res. and eli. duplicates 009.png

A: Get positioned on the client in the group of duplicates you want to remove.

B: Click on Button Remove 1 element list.png.

CAUTION: If there are two clients in a group of duplicates, by clicking on "Remove the client from the list of duplicates", the second client will also be removed automatically.


Res. and eli. duplicates 010.png

There are only two clients left in the group of duplicates out of the initial three.




Remove a Group of Duplicates from the List

The button "Button Remove many elements list.png Remove the group from the list of duplicates" allows you to remove an entire group from the list of duplicates.

Res. and eli. duplicates 011.png

A: Get positioned on one of the clients you want to remove from the group of duplicates.

B: Click on Button Remove many elements list.png.


Res. and eli. duplicates 012.png

The group disappears and the alternating colours adjust accordingly in order to better differentiate the groups of duplicates.




Merge a Group of Duplicates

The button "Button Merge.png Merge the duplicates" allows you to access the merge duplicates interface.

Res. and eli. duplicates 013.png

A: Select a client in the group of duplicates to merge.

B: Click on Button Merge.png.



Res. and eli. duplicates 014.png

A: This column contains the names of the processed fields for each line.

B: This column contains the information of the first client to be merged.

C: This column contains the information of the second client to be merged.

D and E: These two columns contain the information of the other clients to be merged. A maximum of 10 clients can be processed at the same time. If the group contains more than 10 clients, the client resulting from the merge will be placed in the group of duplicates with the remaining clients.

F: This column contains the desired result of the merge.

NOTE: By default, the first available information in client order is entered in column F "Result". For example, if column B "Client 1" is empty and columns C "Client 2" and D "Client 3" contain information, column F "Result" will contain the information of column C "Client 2".

EXCEPTIONS: For the information corresponding to a check box, the answer "Yes" is always selected if it is available for one of the clients to merge.



Res. and eli. duplicates 015.png

A: In this example, the two first clients are duplicates.

B: This client is not a duplicate, so you should remove him from the list.

C: This client is not a duplicate either, so you should also remove him from the list.

D: To remove clients 3 and 4 from the list of duplicates to merge, click on "Button Minus remove delete.png Remove from merge".

NOTE: This option is not available if there are only two clients to merge.



This window opens.

Res. and eli. duplicates 016.png

E: Using the drop-down list, select the client to be removed from the list of duplicates to merge.

B: Click on "Button Check mark Confirm.png OK".


After clicking on "Button Check mark Confirm.png OK" the "Question" window will close automatically. From the merge duplicates window, click again on "Button Minus remove delete.png Remove from merge", to be able to remove the other clients who are not duplicates.

Res. and eli. duplicates 017.png 

G: Using the drop-down list, select the client to be removed from the list of duplicates to merge.

H: Click on "Button Check mark Confirm.png OK".



Res. and eli. duplicates 018.png

I: The "Result" column has been refreshed and the information is put back in client order, if it came from the removed client. The "Result" column contains all the information of the "Client 1" column.

J: Note that the "Button Minus remove delete.png Remove from merge" button is no longer there since there are only two clients in the merge.



Res. and eli. duplicates 019.png

K: It is also possible to assign the information corresponding to a particular client column to the "Result" column. To do so, you need to click on the header of the column. In this example, the "Result" column now contains all the information of "Client 2".



Res. and eli. duplicates 020.png

L: The only fields that remain untouched by this function are the fields highlighted in blue at the bottom of the merge grid. For these fields, the merge is compulsory and there is no other option.



Res. and eli. duplicates 021.png

M: It is also possible to choose manually the wanted result for each orange line. To do so, you need to click on the white cell to be edited in the "Result" column. A button of the drop-down list then appears and displays the possible choices.

NOTE: You can also type the desired information in each of the fields where it is possible to enter information in the client file.



Details and Additional Exceptions

For the "Gender" field, it is always possible to select either "Male" or "Female". You can also delete the information to to leave the cell empty.

For the "Language" field, it is always possible to choose from all the languages available in ProDon.

For the fields corresponding to a check box, it is possible to select "Yes" or "No" only if the answers are available for one of the clients present in the merge interface. For example, if all the clients have "No" at the "No receipt wanted" field, it will be impossible to select "Yes".

For the fields: "Sector, Canvasser, Designated gift, of date type, customized fields of predefined or numerical list type", you must choose from the available choices in accordance with the clients present in the merge interface. For example, if none of the clients has a sector of activity, it will be impossible to choose one.

For the "Categories" field, you must select the information corresponding to a particular client or merge the information of all the clients.

Many verifications are done when merging, some will require your intervention and others will apply automatically. For instance, it is impossible to merge a client for whom you have selected "No" at the "Deceased" field and for whom you would have entered a date of death.


Res. and eli. duplicates 022.png

It is possible to double-click in the "Adress", "Comment" and "Message" fields in order to see the complete information even if it contains several lines.



The green lines contain an identical piece of information for each client.

The orange lines contain different information for at least two clients.

The blue lines contain information that will inevitably be merged.



Document name: ProDon:Searching and Eliminating Duplicates
Version : 4.6.5.5