<div dir="ltr">Hi Alan,<div><br></div><div>Yes! We took an approach to review our cloud version and see if we can port the import functionality, which resolves most of the issues we discussed over here.</div><div><br></div><div>Right now, cloud supports 4 different options in Duplicate Handling as noted below.</div><div><ul><li>Merge & Overwrite, skip blank values from CSV - If a mapped field has blank value in the imported file, then existing value in CRM is retained</li><li>Merge & Overwrite, apply any blank values from CSV - If a mapped field has blank value in the imported file, then existing value in CRM will be removed.</li><li>Skip Duplicates - Duplicates entries in the file will not be imported if a matching record is already in the CRM.</li><li>Don't check Duplicates - All record from import file are imported</li></ul><div>In addition to this unique field is supported during the field mapping step. So that import is carried out successfully.</div></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Sep 16, 2020 at 5:32 PM Alan Lord <<a href="mailto:alanslists@gmail.com">alanslists@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">FWIW, I think it would be helpful if vtiger discussed how this currently <br>
works in vtiger Cloud. In my experience it seems to work quite well there.<br>
<br>
Al<br>
<br>
<br>
On 16/09/2020 12:34, nilay khatri wrote:<br>
> This is what I think would be ideal:<br>
> <br>
> 1. In any case the duplicate records in the CRM should not be merged<br>
> 2. If the operation is merge then *update* all the matching records <br>
> fields, with the field values in the CSV file if the values in the CRM <br>
> record is empty or not equal to default value for that field<br>
> 3. If the operation is overwrite then *update* all the matching records <br>
> fields with the field values in CSV blindly<br>
> <br>
> Since we are not merging duplicate records in CRM into one single record <br>
> anymore it would also be possible to Map the auto-generated fields.<br>
> <br>
> Our team has started work on this and will share the progress soon. <br>
> Please feel free to share your thoughts.<br>
> <br>
> On Tue, Sep 15, 2020 at 2:57 PM Uma S <<a href="mailto:uma.s@vtiger.com" target="_blank">uma.s@vtiger.com</a> <br>
> <mailto:<a href="mailto:uma.s@vtiger.com" target="_blank">uma.s@vtiger.com</a>>> wrote:<br>
> <br>
> Hi Martin,<br>
> <br>
> That's a better idea, We need to improvise on the existing<br>
> options(Merge & overwrite) to import field values in the field<br>
> mapping phase for blank field values and add support to introduce<br>
> unique field in field mapping to resolve this issue.<br>
> <br>
> Thanks! for the insight Martin :) Updated your observation on the<br>
> issue <<a href="https://code.vtiger.com/vtiger/vtigercrm/issues/1483" rel="noreferrer" target="_blank">https://code.vtiger.com/vtiger/vtigercrm/issues/1483</a>>.<br>
> <br>
> <br>
> On Tue, Sep 15, 2020 at 12:54 PM Martin Allen<br>
> <<a href="mailto:martin.allen@clystnet.com" target="_blank">martin.allen@clystnet.com</a> <mailto:<a href="mailto:martin.allen@clystnet.com" target="_blank">martin.allen@clystnet.com</a>>> wrote:<br>
> <br>
> I don't think you need to make the User choose between 'new' or<br>
> 'update' as then they'd potentially have to do two imports<br>
> instead of being able to do both in 1 step - just need to ensure<br>
> that the 'update' or 'merge' method is very explicit in how it<br>
> works (and does work correctly).<br>
> Adding the ability to select autoincrement fields as the<br>
> duplicate check (being the only true Unique ID field) is key to<br>
> making this work properly though. Being the only non-editable<br>
> field, it means you can then update ANY existing field even if<br>
> it's a field you would previously have used as a duplicate check<br>
> field! (Which you can currently do!)<br>
> <br>
> When the record already exists maybe, allowing the User to<br>
> specify per field (in the Field Mapping section) whether to<br>
> always use the supplied value (overwrite), or whichever one is<br>
> not blank (merge), and if both not blank then whether to use the<br>
> supplied value or the existing value?<br>
> <br>
> Martin Allen<br>
> <br>
> *01392 248692 - Main Office<br>
> 01392 690659 - Direct Line*<br>
> <br>
> *signature2*<br>
> <br>
> Have you visited our website recently? <a href="http://www.clystnet.com" rel="noreferrer" target="_blank">http://www.clystnet.com</a><br>
> <<a href="http://www.clystnet.com/" rel="noreferrer" target="_blank">http://www.clystnet.com/</a>><br>
> <br>
> <br>
> The information in this email is confidential If you are not the<br>
> intended recipient, you must not read or use that information.<br>
> This email and any attachments are believed to be virus free<br>
> however no responsibility is accepted by Clystnet for any loss<br>
> or damage arising in any way from receipt or use thereof.<br>
> Clystnet Ltd (company reg number 7164503) is based at Silverdown<br>
> Park, Fair Oak Close, Clyst Honiton, EX5 2UX<br>
> <br>
> <br>
> <br>
> On Tue, 15 Sep 2020 at 07:37, Uma S <<a href="mailto:uma.s@vtiger.com" target="_blank">uma.s@vtiger.com</a><br>
> <mailto:<a href="mailto:uma.s@vtiger.com" target="_blank">uma.s@vtiger.com</a>>> wrote:<br>
> <br>
> Thanks! for the Idea Ruben. Updated the details on the issue<br>
> <<a href="https://code.vtiger.com/vtiger/vtigercrm/issues/1483" rel="noreferrer" target="_blank">https://code.vtiger.com/vtiger/vtigercrm/issues/1483</a>>.<br>
> <br>
> On Mon, Sep 14, 2020 at 9:38 PM Rubén A. Estrada Orozco<br>
> <<a href="mailto:rulotec1@gmail.com" target="_blank">rulotec1@gmail.com</a> <mailto:<a href="mailto:rulotec1@gmail.com" target="_blank">rulotec1@gmail.com</a>>> wrote:<br>
> <br>
> I agree, there should be an "update" option which only<br>
> updates fields in existing records but that doesn't<br>
> create new records. And the merge option that currently<br>
> exists should create records if they do not exist and<br>
> update them if they do (here we would just need to fix<br>
> the existing bugs).<br>
> Saludos<br>
> <br>
> Rubén<br>
> <br>
> <br>
> On Sat, Sep 12, 2020 at 12:12 PM Uma S <<a href="mailto:uma.s@vtiger.com" target="_blank">uma.s@vtiger.com</a><br>
> <mailto:<a href="mailto:uma.s@vtiger.com" target="_blank">uma.s@vtiger.com</a>>> wrote:<br>
> <br>
> Hi Team,<br>
> <br>
> I think we should enhance the import functionality,<br>
> So that systems should first analyze the user's need<br>
> for import on either to update the existing records<br>
> or to replace the record (i.e., delete existing and<br>
> creating new one). Based on selected choice<br>
> consequent steps should be taken on records.<br>
> <br>
> <br>
> <br>
> On Fri, Sep 11, 2020 at 10:42 AM nilay khatri<br>
> <<a href="mailto:nilay.spartan@gmail.com" target="_blank">nilay.spartan@gmail.com</a><br>
> <mailto:<a href="mailto:nilay.spartan@gmail.com" target="_blank">nilay.spartan@gmail.com</a>>> wrote:<br>
> <br>
> And thanks for the input everyone.<br>
> <br>
> <br>
> <br>
> On Fri, Sep 11, 2020 at 12:59 AM Rubén A.<br>
> Estrada Orozco <<a href="mailto:rulotec1@gmail.com" target="_blank">rulotec1@gmail.com</a><br>
> <mailto:<a href="mailto:rulotec1@gmail.com" target="_blank">rulotec1@gmail.com</a>>> wrote:<br>
> <br>
> Naily, I've seen similar issues. When using<br>
> the merge feature for example, we noticed<br>
> that if you have a phone column in your csv<br>
> and its empty and if the record in<br>
> vtgier has already a phone, it gets deleted.<br>
> What you would expect from a merge is that<br>
> it would keep the non-empty field.<br>
> <br>
> I've opened these issues:<br>
> * merge function deletes fields:<br>
> <a href="https://code.vtiger.com/vtiger/vtigercrm/issues/1483" rel="noreferrer" target="_blank">https://code.vtiger.com/vtiger/vtigercrm/issues/1483</a><br>
> * add record number field for updating<br>
> purposes:<br>
> <a href="https://code.vtiger.com/vtiger/vtigercrm/issues/1484" rel="noreferrer" target="_blank">https://code.vtiger.com/vtiger/vtigercrm/issues/1484</a><br>
> <br>
> Saludos<br>
> <br>
> Rubén<br>
> <br>
> <br>
> On Thu, Sep 10, 2020 at 9:36 AM Martin Allen<br>
> <<a href="mailto:martin.allen@clystnet.com" target="_blank">martin.allen@clystnet.com</a><br>
> <mailto:<a href="mailto:martin.allen@clystnet.com" target="_blank">martin.allen@clystnet.com</a>>> wrote:<br>
> <br>
> We've actually written our own import<br>
> scripts that will read a CSV file and<br>
> will update / create records via<br>
> Webservice, allowing you to do a check<br>
> for an existing record using whatever<br>
> fields you want first (and can identify<br>
> and handle if it returns multiple<br>
> records) and then update only the fields<br>
> you want to.<br>
> <br>
> Martin Allen<br>
> <br>
> *01392 248692 - Main Office<br>
> 01392 690659 - Direct Line*<br>
> <br>
> *signature2*<br>
> <br>
> Have you visited our website recently?<br>
> <a href="http://www.clystnet.com" rel="noreferrer" target="_blank">http://www.clystnet.com</a><br>
> <<a href="http://www.clystnet.com/" rel="noreferrer" target="_blank">http://www.clystnet.com/</a>><br>
> <br>
> <br>
> The information in this email is<br>
> confidential If you are not the intended<br>
> recipient, you must not read or use that<br>
> information. This email and any<br>
> attachments are believed to be virus<br>
> free however no responsibility is<br>
> accepted by Clystnet for any loss or<br>
> damage arising in any way from receipt<br>
> or use thereof. Clystnet Ltd (company<br>
> reg number 7164503) is based at<br>
> Silverdown Park, Fair Oak Close, Clyst<br>
> Honiton, EX5 2UX<br>
> <br>
> <br>
> <br>
> On Thu, 10 Sep 2020 at 15:28, Martin<br>
> Allen <<a href="mailto:martin.allen@clystnet.com" target="_blank">martin.allen@clystnet.com</a><br>
> <mailto:<a href="mailto:martin.allen@clystnet.com" target="_blank">martin.allen@clystnet.com</a>>> wrote:<br>
> <br>
> I believe that in vTiger hosted<br>
> version it is possible to have the<br>
> Lead Number (or any Auto Increment<br>
> field in any other module - UI Type<br>
> 4) field included in an Import which<br>
> can then be used for checking for<br>
> duplicates (obviously this field<br>
> value is not imported, only used for<br>
> duplicate checking).<br>
> <br>
> Would be good if this was available<br>
> in the open source version, as it<br>
> would make importing data (to update<br>
> records rather than creating new<br>
> ones) much simpler and safer, as any<br>
> other field cannot be guaranteed to<br>
> be unique, and sometimes the field<br>
> you want to update are the fields<br>
> that you would typically use to<br>
> identify duplicates (i.e. First<br>
> Name, Last Name, Email Address for<br>
> Contacts)<br>
> <br>
> Martin Allen<br>
> <br>
> *01392 248692 - Main Office<br>
> 01392 690659 - Direct Line*<br>
> <br>
> *signature2*<br>
> <br>
> Have you visited our website<br>
> recently? <a href="http://www.clystnet.com" rel="noreferrer" target="_blank">http://www.clystnet.com</a><br>
> <<a href="http://www.clystnet.com/" rel="noreferrer" target="_blank">http://www.clystnet.com/</a>><br>
> <br>
> <br>
> The information in this email is<br>
> confidential If you are not the<br>
> intended recipient, you must not<br>
> read or use that information. This<br>
> email and any attachments are<br>
> believed to be virus free however no<br>
> responsibility is accepted by<br>
> Clystnet for any loss or damage<br>
> arising in any way from receipt or<br>
> use thereof. Clystnet Ltd (company<br>
> reg number 7164503) is based at<br>
> Silverdown Park, Fair Oak Close,<br>
> Clyst Honiton, EX5 2UX<br>
> <br>
> <br>
> <br>
> On Thu, 10 Sep 2020 at 13:22, nilay<br>
> khatri <<a href="mailto:nilay.spartan@gmail.com" target="_blank">nilay.spartan@gmail.com</a><br>
> <mailto:<a href="mailto:nilay.spartan@gmail.com" target="_blank">nilay.spartan@gmail.com</a>>> wrote:<br>
> <br>
> This is a very common challenge,<br>
> users want to update certain<br>
> data of records in CRM by<br>
> importing a CSV.<br>
> <br>
> Let us say Leads, we want to<br>
> update Lead Status, so the CSV<br>
> sheet contains 2 columns Primary<br>
> Email and Status.<br>
> <br>
> If we import the CSV and set the<br>
> duplicate check criteria in step<br>
> 2 on Primary Email and import<br>
> following things would happen:<br>
> <br>
> - quite possible all the other<br>
> data in fields will be wiped out<br>
> - if the system contains more<br>
> than 1 Lead with same email id,<br>
> it would delete them, keeping<br>
> only 1<br>
> - the record IDs will change<br>
> <br>
> If I talk about contact module<br>
> that is full of surprises,<br>
> contact Id is available to<br>
> select in the duplicate<br>
> selection criteria, but not<br>
> available in the field mapping!<br>
> <br>
> --------------------------------------<br>
> <br>
> <br>
> In the end we want to achieve a<br>
> very simple thing, import a List<br>
> of Leads and update respective<br>
> status without changing record<br>
> Ids or deleting any other<br>
> matching record in system.<br>
> <br>
> <br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
> <br>
> <br>
> -- <br>
> With<br>
> Best Regards<br>
> Uma.S<br>
> Vtiger Team<br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
> <br>
> <br>
> -- <br>
> With<br>
> Best Regards<br>
> Uma.S<br>
> Vtiger Team<br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
> <br>
> <br>
> -- <br>
> With<br>
> Best Regards<br>
> Uma.S<br>
> Vtiger Team<br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
> <br>
> _______________________________________________<br>
> <a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a><br>
> <br>
_______________________________________________<br>
<a href="http://www.vtiger.com/" rel="noreferrer" target="_blank">http://www.vtiger.com/</a></blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr">With<br>Best Regards<br>Uma.S<br><div>Vtiger Team</div></div></div>