[Vtigercrm-developers] "Failed - Network error" when downloading report in CSV format

nilay khatri nilay.spartan at gmail.com
Fri Jul 23 13:33:04 GMT 2021


Ruben, when you download report in excel format, are you able to open the
file properly?

On Fri, Jul 23, 2021 at 10:04 AM Uma S <uma.s at vtiger.com> wrote:

> Hi Nilay, Martin & Ruben,
>
> Thanks! you all for deep insights on this issue.
>
> I am reporting an issue
> <https://code.vtiger.com/vtiger/vtigercrm/issues/1632> to capture all
> details and it's useful for further conversation, We will brainstorm on
> this and get it addressed in our pipeline.
>
> On Thu, Jul 22, 2021 at 10:37 PM nilay khatri <nilay.spartan at gmail.com>
> wrote:
>
>>
>> Usually that’s the case with excel, some where extra line and that breaks
>> the output. Not sure what would be the case for CSV here then.
>>
>> On Thu, 22 Jul 2021 at 9:45 PM, Rubén A. Estrada Orozco <
>> rulotec1 at gmail.com> wrote:
>>
>>> Thanks for your reply Nilay and Martin
>>>
>>> I think in my case it's not related to the size of the file or the
>>> available memory. It's just a few records as in Martin's case.
>>> It seems that such an error can come up when there's a mismatch between
>>> the reported size in the http headers and the actual size of the file. But
>>> I'm not sure that's the problem in this case. This particular vtiger
>>> instance is hosted at SiteGround. I was wondering whether it's a nginx
>>> configuration thing.
>>> The weirdest thing is that when I turn on warnings, the file then
>>> downloads correctly but with this warning at the top of the file:
>>>
>>> <b>Warning</b>:  Declaration of
>>> Reports_ExportReport_View::preProcess(Vtiger_Request $request) should be
>>> compatible with Vtiger_View_Controller::preProcess(Vtiger_Request
>>> $request,  $display = true) in <b>/home/customer/www/
>>> crm.jocasasegurosyfianzas.com/public_html/modules/Reports/views/ExportReport.php</b>
>>> on line <b>0</b><br />
>>>
>>> Saludos
>>>
>>> Rubén
>>>
>>>
>>> On Thu, Jul 22, 2021 at 3:04 AM Martin Allen <
>>> martin.allen at exe-squared.co.uk> wrote:
>>>
>>>> We are seeing the same issue when exporting a CSV report – which only
>>>> contains 22 records  with a single query (that does not involve any
>>>> permissions) and PHP has 512mb memory limit….again exporting as Excel works
>>>> fine…
>>>>
>>>>
>>>>
>>>> *From:* vtigercrm-developers-bounces at lists.vtigercrm.com <
>>>> vtigercrm-developers-bounces at lists.vtigercrm.com> *On Behalf Of *nilay
>>>> khatri
>>>> *Sent:* 22 July 2021 07:23
>>>> *To:* Vtiger Developers List <vtigercrm-developers at lists.vtigercrm.com>
>>>> *Subject:* Re: [Vtigercrm-developers] "Failed - Network error" when
>>>> downloading report in CSV format
>>>>
>>>>
>>>>
>>>> @Ruben, also increase memory limit if you are exporting in CSV format.
>>>>
>>>>
>>>>
>>>> On Thu, Jul 22, 2021 at 11:46 AM nilay khatri <nilay.spartan at gmail.com>
>>>> wrote:
>>>>
>>>> One more thing, the CSV output generation is not optimized, you can not
>>>> store the entire resultset into an array and then pipe to a CSV file.
>>>>
>>>>
>>>>
>>>> On Thu, Jul 22, 2021 at 11:43 AM nilay khatri <nilay.spartan at gmail.com>
>>>> wrote:
>>>>
>>>> Uma, for this you really need to test Vtiger with a large data set
>>>> where scalability becomes an issue. There are many issues similar to this,
>>>> which can not be addressed with the current architecture of Vtiger. I am
>>>> eager to hear that I am wrong.
>>>>
>>>>
>>>>
>>>> - Mass edits
>>>>
>>>> - Report export
>>>>
>>>> - Export from List
>>>>
>>>> - Imports
>>>>
>>>>
>>>>
>>>> When you work with a large data set, there is no foolproof/predictable
>>>> way to scale.
>>>>
>>>>
>>>>
>>>> For example, this given case of report export. Suppose we had put
>>>> conditions which involve full scan and is a non-admin with sharing rules
>>>> etc, the query becomes really complex and can easily go for more than 5-10
>>>> minutes (even for small data sets, let us say 30-40K records as well).
>>>>
>>>>
>>>>
>>>> Generally php time limits are set to less than 1 min. But anyways you
>>>> can predefine what could be the time required to execute the various
>>>> queries. So you might have to leave the configuration on the higher side,
>>>> which would be a workaround but would again fail if something needs even
>>>> more resources/time. And it is not good to leave 1 GB memory and 30 min of
>>>> execution time limit :)
>>>>
>>>>
>>>>
>>>> Another challenge is that if you put your CRM behind a OSI layer 3
>>>> firewall / filtering, these normally have very short TTFB limits, usually <
>>>> 100 sec. Which again terminates the request and can lead to the above
>>>> situation.
>>>>
>>>>
>>>>
>>>> That's the same case where there are no event triggers for mass edits.
>>>> As a workaround Vtiger decided to introduce bulk mode to simply skip events
>>>> and limit the record selection to 500! Though there is a concept of batch
>>>> event, but never implemented.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Thu, Jul 22, 2021 at 11:08 AM Uma S <uma.s at vtiger.com> wrote:
>>>>
>>>> Hi Ruben,
>>>>
>>>>
>>>>
>>>> I validated this case of Export CSV in Reports, which works perfectly
>>>> fine.
>>>>
>>>>
>>>>
>>>> Can you please be more precise on the case scenario, Did you notice any
>>>> errors logs and what is the size of your report? I mean the number of
>>>> records?
>>>>
>>>>
>>>>
>>>> On Thu, Jul 22, 2021 at 8:25 AM Rubén A. Estrada Orozco <
>>>> rulotec1 at gmail.com> wrote:
>>>>
>>>> I'm having and issue where downloading any report in CSV format gives
>>>> this error:
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> It doesn't happen when using Excel format.
>>>>
>>>>
>>>>
>>>> It happened in vtiger 7.0.1 and still happens after upgrading to 7.4
>>>>
>>>>
>>>>
>>>> Any ideas?
>>>>
>>>>
>>>> Saludos
>>>>
>>>>
>>>>
>>>> Rubén
>>>>
>>>> _______________________________________________
>>>> http://www.vtiger.com/
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> With
>>>> Best Regards
>>>> Uma.S
>>>>
>>>> Vtiger Team
>>>>
>>>> _______________________________________________
>>>> http://www.vtiger.com/
>>>>
>>>> _______________________________________________
>>>> http://www.vtiger.com/
>>>
>>> _______________________________________________
>>> http://www.vtiger.com/
>>
>> _______________________________________________
>> http://www.vtiger.com/
>
>
>
> --
> With
> Best Regards
> Uma.S
> Vtiger Team
> _______________________________________________
> http://www.vtiger.com/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.vtigercrm.com/pipermail/vtigercrm-developers/attachments/20210723/0d9d233d/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 5478 bytes
Desc: not available
URL: <http://lists.vtigercrm.com/pipermail/vtigercrm-developers/attachments/20210723/0d9d233d/attachment-0001.png>


More information about the vtigercrm-developers mailing list