[Vtigercrm-developers] Importing records

[lajeesh k]

Thanks Alan for sharing this script,

I have made a small change to mysql configuration and I got a surprising
performance,
Now 5 lacks of records got imported in less than 45 minutes

this is the change I have made

innodb_flush_log_at_trx_commit = 0
innodb_flush_method = O_DIRECT

I have a dedicated server



Regards,
Lajeesh

On Mon, Sep 28, 2015 at 12:28 PM, Alan Lord <alanslists at gmail.com> wrote:

> On 26/09/15 09:24, lajeesh k wrote:
>
>>
>> @Alan can you share your server api script with us, so that i can save
>> time for writing the script
>>
>>
> Something like this should help you get started.
>
> http://paste.ubuntu.com/12600586/
>
> This is for vtiger 5.4.0 but there won't be much change to make it work
> for 6; probably just include the main webUI entry point.
>
> Note this script reads in a csv file with the separator a semi-colon.
>
> For large imports I break the csv file into multiple files of say 50,000
> each and then call this script from a bash shell script wrapper which does
> something like this:
>
> for FILE in ${FILES}
>>
>> do
>>         php -f write-csv.php ${FILEPATH}${FILE}
>> done
>>
>
>
> HTH
>
>
> Al
>
>
>
> _______________________________________________
> http://www.vtiger.com/
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.vtigercrm.com/pipermail/vtigercrm-developers/attachments/20150928/1c5751fe/attachment.html>