Wow! thanks.<br><br><div class="gmail_quote">On Fri, Mar 15, 2013 at 11:48 AM, Adam Heinz <span dir="ltr"><<a href="mailto:amh@metricwise.net" target="_blank">amh@metricwise.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">I found a 100x performance improvement [1] in the csv export code today.  Turns out, if you don't do 1-4 database calls for every one of the 16,000 customers you're exporting, you can get your export time down from 80 minutes to 30 seconds.<font color="#000000"><span style="white-space:pre-wrap">  The </span></font><span style="white-space:pre-wrap">sanitizeValues function [2] is pretty much useless.  It wastes a ton of CPU cycles calling </span><font color="#000000"><span style="white-space:pre-wrap">fetchUserRole and getSubordinateRoleAndUsers (via getAssignedPicklistValues).  It populates the picklistValues member variable, which is never used.  It replaces uitype 10 crmids with entity names, which I like less than displaying the crmids, exporting the related tables, and using Excel VLOOKUP to do the cross referencing; essentially preserving referential integrity in your exported spreadsheets.</span></font><div>

<br></div><div>[1]</div><div><pre style="white-space:pre-wrap;word-wrap:break-word">Index: include/utils/export.php
===================================================================
--- include/utils/export.php    (revision 3285)
+++ include/utils/export.php    (revision 3943)
@@ -214,6 +214,6 @@
     while($val = $adb->fetchByAssoc($result, -1, false)){
                $new_arr = array();
-               $val = $__processor->sanitizeValues($val);
+//             $val = $__processor->sanitizeValues($val);
                foreach ($val as $key => $value){
                        if($type == 'Documents' && $key == 'description'){
</pre></div><div>[2] <a href="http://trac.vtiger.com/cgi-bin/trac.cgi/browser/vtigercrm/branches/5.4.0/include/utils/export.php#L280" target="_blank">http://trac.vtiger.com/cgi-bin/trac.cgi/browser/vtigercrm/branches/5.4.0/include/utils/export.php#L280</a></div>

</div>
<br>_______________________________________________<br>
<a href="http://www.vtiger.com/" target="_blank">http://www.vtiger.com/</a><br></blockquote></div><br>