[Vtigercrm-developers] "Failed - Network error" when downloading report in CSV format

Uma S uma.s at vtiger.com
Fri Jul 23 04:32:37 GMT 2021


Hi Nilay, Martin & Ruben,

Thanks! you all for deep insights on this issue.

I am reporting an issue
<https://code.vtiger.com/vtiger/vtigercrm/issues/1632> to capture all
details and it's useful for further conversation, We will brainstorm on
this and get it addressed in our pipeline.

On Thu, Jul 22, 2021 at 10:37 PM nilay khatri <nilay.spartan at gmail.com>
wrote:

>
> Usually that’s the case with excel, some where extra line and that breaks
> the output. Not sure what would be the case for CSV here then.
>
> On Thu, 22 Jul 2021 at 9:45 PM, Rubén A. Estrada Orozco <
> rulotec1 at gmail.com> wrote:
>
>> Thanks for your reply Nilay and Martin
>>
>> I think in my case it's not related to the size of the file or the
>> available memory. It's just a few records as in Martin's case.
>> It seems that such an error can come up when there's a mismatch between
>> the reported size in the http headers and the actual size of the file. But
>> I'm not sure that's the problem in this case. This particular vtiger
>> instance is hosted at SiteGround. I was wondering whether it's a nginx
>> configuration thing.
>> The weirdest thing is that when I turn on warnings, the file then
>> downloads correctly but with this warning at the top of the file:
>>
>> <b>Warning</b>:  Declaration of
>> Reports_ExportReport_View::preProcess(Vtiger_Request $request) should be
>> compatible with Vtiger_View_Controller::preProcess(Vtiger_Request
>> $request,  $display = true) in <b>/home/customer/www/
>> crm.jocasasegurosyfianzas.com/public_html/modules/Reports/views/ExportReport.php</b>
>> on line <b>0</b><br />
>>
>> Saludos
>>
>> Rubén
>>
>>
>> On Thu, Jul 22, 2021 at 3:04 AM Martin Allen <
>> martin.allen at exe-squared.co.uk> wrote:
>>
>>> We are seeing the same issue when exporting a CSV report – which only
>>> contains 22 records  with a single query (that does not involve any
>>> permissions) and PHP has 512mb memory limit….again exporting as Excel works
>>> fine…
>>>
>>>
>>>
>>> *From:* vtigercrm-developers-bounces at lists.vtigercrm.com <
>>> vtigercrm-developers-bounces at lists.vtigercrm.com> *On Behalf Of *nilay
>>> khatri
>>> *Sent:* 22 July 2021 07:23
>>> *To:* Vtiger Developers List <vtigercrm-developers at lists.vtigercrm.com>
>>> *Subject:* Re: [Vtigercrm-developers] "Failed - Network error" when
>>> downloading report in CSV format
>>>
>>>
>>>
>>> @Ruben, also increase memory limit if you are exporting in CSV format.
>>>
>>>
>>>
>>> On Thu, Jul 22, 2021 at 11:46 AM nilay khatri <nilay.spartan at gmail.com>
>>> wrote:
>>>
>>> One more thing, the CSV output generation is not optimized, you can not
>>> store the entire resultset into an array and then pipe to a CSV file.
>>>
>>>
>>>
>>> On Thu, Jul 22, 2021 at 11:43 AM nilay khatri <nilay.spartan at gmail.com>
>>> wrote:
>>>
>>> Uma, for this you really need to test Vtiger with a large data set where
>>> scalability becomes an issue. There are many issues similar to this, which
>>> can not be addressed with the current architecture of Vtiger. I am eager to
>>> hear that I am wrong.
>>>
>>>
>>>
>>> - Mass edits
>>>
>>> - Report export
>>>
>>> - Export from List
>>>
>>> - Imports
>>>
>>>
>>>
>>> When you work with a large data set, there is no foolproof/predictable
>>> way to scale.
>>>
>>>
>>>
>>> For example, this given case of report export. Suppose we had put
>>> conditions which involve full scan and is a non-admin with sharing rules
>>> etc, the query becomes really complex and can easily go for more than 5-10
>>> minutes (even for small data sets, let us say 30-40K records as well).
>>>
>>>
>>>
>>> Generally php time limits are set to less than 1 min. But anyways you
>>> can predefine what could be the time required to execute the various
>>> queries. So you might have to leave the configuration on the higher side,
>>> which would be a workaround but would again fail if something needs even
>>> more resources/time. And it is not good to leave 1 GB memory and 30 min of
>>> execution time limit :)
>>>
>>>
>>>
>>> Another challenge is that if you put your CRM behind a OSI layer 3
>>> firewall / filtering, these normally have very short TTFB limits, usually <
>>> 100 sec. Which again terminates the request and can lead to the above
>>> situation.
>>>
>>>
>>>
>>> That's the same case where there are no event triggers for mass edits.
>>> As a workaround Vtiger decided to introduce bulk mode to simply skip events
>>> and limit the record selection to 500! Though there is a concept of batch
>>> event, but never implemented.
>>>
>>>
>>>
>>>
>>>
>>> On Thu, Jul 22, 2021 at 11:08 AM Uma S <uma.s at vtiger.com> wrote:
>>>
>>> Hi Ruben,
>>>
>>>
>>>
>>> I validated this case of Export CSV in Reports, which works perfectly
>>> fine.
>>>
>>>
>>>
>>> Can you please be more precise on the case scenario, Did you notice any
>>> errors logs and what is the size of your report? I mean the number of
>>> records?
>>>
>>>
>>>
>>> On Thu, Jul 22, 2021 at 8:25 AM Rubén A. Estrada Orozco <
>>> rulotec1 at gmail.com> wrote:
>>>
>>> I'm having and issue where downloading any report in CSV format gives
>>> this error:
>>>
>>>
>>>
>>>
>>>
>>> It doesn't happen when using Excel format.
>>>
>>>
>>>
>>> It happened in vtiger 7.0.1 and still happens after upgrading to 7.4
>>>
>>>
>>>
>>> Any ideas?
>>>
>>>
>>> Saludos
>>>
>>>
>>>
>>> Rubén
>>>
>>> _______________________________________________
>>> http://www.vtiger.com/
>>>
>>>
>>>
>>>
>>> --
>>>
>>> With
>>> Best Regards
>>> Uma.S
>>>
>>> Vtiger Team
>>>
>>> _______________________________________________
>>> http://www.vtiger.com/
>>>
>>> _______________________________________________
>>> http://www.vtiger.com/
>>
>> _______________________________________________
>> http://www.vtiger.com/
>
> _______________________________________________
> http://www.vtiger.com/



-- 
With
Best Regards
Uma.S
Vtiger Team
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.vtigercrm.com/pipermail/vtigercrm-developers/attachments/20210723/ad705cb3/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 5478 bytes
Desc: not available
URL: <http://lists.vtigercrm.com/pipermail/vtigercrm-developers/attachments/20210723/ad705cb3/attachment.png>


More information about the vtigercrm-developers mailing list