[Vtigercrm-developers] migration of large database...

[Alan Lord (News)]

On 19/11/14 21:53, Richard Hills - Technologywise wrote:
> Yes!
>
> I have been using Alan's workaround script in order to be able to get
> our system to upgrade to 6.0.0 as a step in our attempts to move to
> 6.1.0 however we are yet to see a 6.1.0 migration complete and I would
> not be surprised if this is the cause (it was the cause of us not being
> able to update to 6.0.0 earlier..). Our crmentity table is around 3m
> entries and our server is unfortunately not as nice sounding as Alan's.

There are two particularly bad bits of coding in the current migration 
scripts:

1. The Label populator routine, which although works is massively 
inefficient and slow. (For 5.4.0 you can circumvent it by adding the 
label column and filling it with something, e.g. a dash '-', before 
running the migration. For 600_to_610 though it runs irrespectively and 
you have to comment out the code before starting the migration process.)

2. The PBXManager code (See recent post "600_610.php migration script") 
which actually does nothing at all!!! But takes an age to run whilst 
doing it.

I would also really like to be able to run these migration scripts from 
the command line...

Using a browser is hopeless when it's a big database. You wait hours, 
getting no feedback, and then something stops or breaks and you have no 
idea what happened.

I've hacked one script to work from the cli and it is much better - you 
get feedback as each routine runs, you can record the output to a text 
file for later study... You could, if you wanted to, break the migration 
into stages.

> Hoping that some time can be spent on this by the vtiger team.

Me too.

Al


-- 
Libertus Solutions
http://www.libertus.co.uk